9 


VOL 


UNIVERSITY 


SCHOOL 


OF BUSIN 


ESS 


AND PUBLIC 
ADMINISTRATION 


on 
| 
NW 
iy YQ 
1| MAS | 
> \ 
| \ \\\ | PALS 
| 
| 
1 | EM PLE 
}\} 
| | | 
NI 
} 
= 4 ( 
_ 
— 
| 


TABLE OF CONTENTS 


The 1956 Elections: Retrospect and 


WILLIAM J. McKENNA 


Attitude Survey een in 
Industrial Relations Page 
JAMES H. MULLEN 


Creative Thinking: Practical Techniques and 
Evaluation Methods Page 


CLAIR JAMES REILLY 


Philadelphia Business Index 


ROBERT T. KLINE 


Index to Volume IX Page 


30 


35 


36 


» 


JUNE, 1957 


ECONOMICS AND BUSINESS BULLETIN 
OF THE 
SCHOOL OF BUSINESS AND PUBLIC ADMINISTRATION 


Published by the 
BUREAU OF ECONOMIC AND BUSINESS RESEARCH 
JOHN F. ADAMS, Director 


Committee for Economic and Business Research 


HARRY A. COCHRAN, Dean MYRON S. HEIDINGSFIELD 
JOHN F. ADAMS IRWIN S. HOFFER 
W. ROY BUCKWALTER RUSSELL H. MACK 


var 
! : 


Tue Bureau of Economic and Business Research of the 
Temple University School of Business and Public Admin- 
istration was organized to provide a vehicle for stimulat- 
ing and coordinating analytical studies. Its primary 
objectives include (1) service to the alumni as well as to 
the faculty and students of the University by bringing 
to their attention pertinent developments in the world of 
business, and (2) service to business and government by 
making contributions to the solution of specific problems. 
To this end, the Bureau both carries on specialized research 
and publishes quarterly the Economics and Business 
Bulletin, containing some of the significant results of its 
current studies. 


The reader’s appraisal of the Bulletin and comments 
upon it are solicited. The Bureau also will appreciate 
receiving suggestions and requests for particular studies. 


The opinions and views expressed in the articles con- 
tained in this Bulletin are those of the writers and cannot 
be construed as the official opinions or policies of the 
School of Business. 
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The 1956 Elections: Retrospect and Prospect 
by WILLIAM J. McKENNA* 


This article provides an analysis of the 
1956 Presidential election by state 
groupings and an analysis of the Con- 
gressional vote in close districts. An 
appraisal is also made of the possible 
outcomes of the 1958 Congressional and 
Senatorial elections. 


NoveEMBER 6, 1956, ended one of the 
most unusual presidential campaigns in 
the history of the United States. The 
Democratic presidential nominee, Adlai 
Stevenson, had been opposed during the 
nominating convention by that shrewd 
politician, ex-President Truman, as a 
man who “could not win.” However, 
Adlai Stevenson was regarded by many 
as a new type of presidential candidate— 
an intellectual, a man of the highest 
principles, and a man with vision and 
foresight. These same people regarded 
Senator Estes Kefauver of Tennessee, 
the nominee for Vice President, as a prac- 
tical politician, a man close to the 
farmer and to the grass roots. This 
Stevenson-Kefauver ticket was heralded 
as the strongest possible for the Demo- 
crats. 

Opposed to Stevenson and Kefauver 
was the same combination as for 1952— 
Eisenhower and Nixon. The campaign 
was conducted on a rather high level for 
the most part. The personalities of 
President Eisenhower and Vice President 
Nixon dominated the campaign. Seldom 
has a presidential candidate been subject 
to less personal attack or abuse, and 
rarely has a vice presidential candidate 
been the target for so much. 

Nevertheless on November 6, 1956, the 
re-election of Eisenhower and Nixon was 
overwhelming. The Republican ticket 
received a plurality of more than 9.6 


*William J. McKenna is an Assistant Profes- 
sor of Economics in the Temple University 
eocae of Business and Public Adminis- 
ration. 


million popular votes and 457 electoral 
votes.! In the last century only Franklin 
D. Roosevelt had received a greater ma- 
jority of popular votes and/or a greater 
number of electoral votes. (See Table 


Yet, despite the overwhelming victory 
of the Eisenhower-Nixon ticket, the Re- 
publican party failed to carry either 
house of Congress. The Democrats won 
the Senate by 49 to 47 and the House of 
Representatives by 234 to 201.2 This 
was the most extraordinary result of the 
presidential election. Only in 18483 had 
the successful party in a presidential 
campaign failed to carry at least one 
house of Congress. But the 1848 elec- 
tion of Zackary Taylor can hardly be 
considered a precedent. Candidate Tay- 
lor, a Whig, won the election because 
the Democratic party had split. The 
regular Democrats nominated Lewis Cass 
as their candidate, while Martin Van 
Buren was the candidate of the dissident 
Democratic organization, the Free Soil 
Party. The combined votes of Cass and 
Van Buren exceeded the total of Taylor 
by 151.7 thousand.4 


It would have been unusual for the 
successful party in a presidential cam- 
paign to lose even one house of Con- 


1The total official vote for all parties was 
62,027,040. The total Republican vote was 
35,581,003 (58.0 percent of two-party vote) and 
the total Democratic vote was 25,738,765 (42.0 
percent of two-party vote). Other votes were 
received by six minor parties (See: Statistics 
of the Presidential and Congressional Elec- 
tions of November 6, 1956, Official, Ralph R. 
Roberts, Clerk of House of Representatives, 
U. S. Government Printing Office, Washing- 
ton, D. C., March 21, 1957). The Democratic 
presidential ticket also received the entire 
vote of the Liberal Party of New York 
(292,557). 

2This represented a net gain of two seats in 
the House of Representatives and a retention 
of exactly the same majority in the Senate. 

8The Congressional election in 1848 consis- 
ted of 112 Democrats and 109 Whigs in the 
House of Representatives and 35 Democrats 
and 25 Whigs in the Senate. 


4In the 1848 election Taylor received 1.4 
million votes and Cass 1.2: million votes, and 
Van Buren 291.3 thousand. This was a total 
of 1.6 million for Cass and Van Buren. 
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gress—let alone both.5 The great 
strength shown by the Democratic party 
in local elections was one of the most 
striking features of the 1956 presidential 
election. 


ANALYSIS OF VOTE 
BY STATES 


An analysis of the 1956 presidential 
vote by states reveals an interesting 
phenomenon. In 1956 the Republican 
ticket increased its percentage of the 
major party vote from 55.4 percent to 
58.0 percent; yet, despite this increase, 
the Republican ticket suffered a decrease 
in its popular vote percentage in 17 
states. (See Table 2.) Most of these 
17 states were in the West and Far 
West and reflected the effect of the farm 
and the public power issues. It was in 
these states that Senator Kefauver con- 
ducted his most active campaign, and, 
moreover, these were states in which the 
local Democratic party was most effect- 
ively organized. 


When the vote of the various states 
is broken down according to the big 
states, the agricultural states, the south- 
ern states and the industrial states, an 
interesting pattern is indicated. 


THE BIG FOUR 


These states include California, Illin- 
ois, Pennsylvania and New York. Among 
these, only in California did the Republi- 
can ticket secure a smaller percentage 
of the popular vote in 1956 than in 1952 
(55.5 percent compared with 56.9 per- 
cent). New York gave the Republican 
ticket the greatest increase, 61.1 percent 
compared with 56.0 percent (See Table 
3). The national Republican ticket ran 
ahead of the local ticket in each of these 
four states.6 


5In 1876, Hayes failed to carry the House 
of Representatives. The Democrats had 153 
seats to 140 for the Republicans. Again, in 
1916, Wilson lost the House of Representa- 
tives, 210 to 216, but sufficient independents 
voted with the Democratic Party to give them 
the privilege of organizing the House of 
Representatives. 

6For example: President Eisenhower ran 
ahead of Senator Javitz (New York) by 627.9 
thousand votes; Senator Duff (Pennsylvania) 
by 335.7 votes; Senator Kuchel (California) 
by 134.8 thousand votes; and Senator Dirksen 
(Illinois) by 316.0 thousand votes. 


INDUSTRIAL STATES 


It is not intended by this classification 
to exclude the “big-four”’ states from 
the industrial group. Rather, it is in- 
tended to consider separately the four 
politically strategic states of Ohio, 
Michigan, New Jersey, and Massa- 
chusetts, all largely industrial in charac- 
ter and subject to much the same in- 
fluences. It was expected that the 
spotty unemployment existing in Michi- 
gan would adversely affect the Republican 
chances. The good Republican reception 
in New Jersey was unexpected in view 
of the great political strength of 
Governor Meyner who had been elected 
in 1953 by a majority over 160.0 
thousand votes. In Ohio the tre- 
mendous political popularity of Governor 
Lausche,? the Democratic candidate for 
United States Senator, was expected to 
aid the whole Democratic ticket. In 
Massachusetts the hope existed that a 
Democratic trend would assure a close 
contest. None of these hopes material- 
ized. Only in Michigan did the Hisen- 
hower-Nixon ticket fail to improve its 
percentage of the Democratic-Republican 
vote over 1952. In each of the other 
three states in this category the Republi- 
can majority increased substantially. In 
fact, the 11.6 percent increase which 
New Jersey gave to the Republican 
ticket was one of the greatest gains 
reported in any state in the nation. (See 
Table 3.) 


AGRICULTURAL AREAS 


The Republican party experienced its 
greatest decline in voting strength in the 
agricultural states. The fact that the 
Republican party did not suffer even 
greater losses is a tribute to the great 
political force of the Eisenhower per- 
sonality and to the improving agricul- 
tural situation in these areas. In seven 
of these nine agricultural states the Re- 
publican party’s strength in 1956 de- 
clined from that recorded in 1952. The 


7In Ohio, George Bender received approxi- 
mately 602.0 thousand less votes than did the 
Eisenhower-Nixon ticket, This was a tribute 
to the great vote-getting ability of Mr. 
Lausche. 
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loss of strength was only 0.9 of a per- 
centage point in Missouri but was 10.9 
percentage points in South Dakota, and 
9.3 percentage points in North Dakota. 
Only in Wisconsin and Indiana did the 
Eisenhower-Nixon ticket secure a gain 
over 1952. (See Table 3.) 


SOUTHERN STATES 

Notable gains were made by the 
Eisenhower-Nixon ticket in the tradi- 
tional Democratic South. Only two of 
the thirteen Southern states failed to give 
this ticket an increased percentage of 
the popular vote. The Republican de- 
cline in South Carolina was the result 
of the failure of the Democratic leader- 
ship to pursue the same anti-Stevenson 
policy followed in 1952 under the leader- 
ship of James Byrnes. The pro-civil 
rights policy of the Republican party was 
an important factor in losing support in 
the deeply Democratic state of Missis- 
sippi. The upsurge in the strength of 
the Republican presidential ticket in the 
eleven other Southern states was a 
product of division in the Democratic 
forces within those states, the increased 
vote of the Negroes, and the changing 
economic and social characters of those 
states. While this trend toward the 
Republican party is important, it does 
not indicate a permanent shift, for the 
Republican party made little progress in 
local offices. Only in Louisiana was the 
strength of the Eisenhower-Nixon ticket 
regarded as a major upset (See Table 
3). This state went Republican for the 
first time in national elections since the 
disputed Hayes-Tilden election of 1876.8 


STATES WITH LOSS OF 
REPUBLICAN STRENGTH 

There were seventeen states in which 
the Eisenhower-Nixon ticket secured a 
smaller percentage of the Republican- 
Democratic vote in 1956 than in 1952. 
California alone, among the big states, 
gave the Republican ticket a smaller 
percentage; and this occurred even with 
a Californian on the ticket. It may 

8In the Hayes-Tilden election of 1876, 
Louisiana, one of the disputed electoral states, 


was awarded to Hayes by the special Elec- 
toral Commission established by Congress. 


give some evidence of the controversial 
nature of the Nixon candidacy in Cali- 
fornia.® The loss of strength of the 
Republican ticket in Mississippi and in 
South Carolina has already been noted 
above as has the percentage loss in seven 
of the nine agricultural states. Losses 
were also suffered by the national Re- 
publican ticket in the far Western and 
Mid-Western states of Oregon, Washing- 
ton, Wyoming, Idaho, Montana, and 
Nevada (See Tables 2 and 3.) The weak- 
ness of the national Republican ticket in 
these latter states was essentially the 
result of the force of the power issue, 
internal political conflicts, and other local 
factors.19 


SUMMARY OF 
STATE VOTES 


A summary of the thirty states in- 
cluded in the categories of the “big four,” 
the agricultural, the Southern, and the 
industrial states is presented in Table 4. 
These thirty states accounted for 
29,800,567 of the 35,581,003 votes re- 
ceived by the Eisenhower-Nixon ticket 
in 1956. Inasmuch as the Republican 
ticket showed a percentage increase in 
only twenty of these thirty states, the 
total percentage of the Republican vote 
for 1956 was somewhat below that of 
1952—83.8 percent in 1956 compared 
with 86.2 percent in 1952. However, the 
notable increase in most of the remain- 
ing twenty states in this group of thirty 
was an important offset to the decline 
in the remaining ten states. 


ANALYSIS OF 
CONGRESSIONAL VOTE 


The most surprising aspect of the 
1956 presidential election was the failure 
of the Republican party, despite the vic- 
tory of the national ticket, to win control 
of at least one house of Congress. Most 
political writers and commentators had 


9However, Estes Kefauver, the Democratic 
coandidate for Vice President failed to carry 
his home state of Tennessee. This reflected 
the dispute within Tennessee between the 
Democratic organization and Senator Ke- 
fauver. 

10Democratic senators were elected in Ore- 
gon, Washington, and Colorado despite the 
victory of the Eisenhower-Nixon ticket. 
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expected a much closer Republican 
presidential victory. They were also al- 
most unanimous in the opinion that the 
Republican party would lose the House 
of Representatives, and that the Senate 
would be close. But most of these 
political writers and commentators had 
predicated their conclusions upon the 
assumption that the Eisenhower-Nixon 
ticket would receive a smaller percentage 
of the total popular vote than in 1952. 
The consensus was that if the national 
Republican ticket substantially increased 
its popular majority, it would carry both 
houses of Congress.1!1 


In the contest for seats in the House 
of Representatives, the Republican party 
gained ten seats!? but lost twelve.!% 
This represented a net gain of two seats 
for the Democrats in the House of 
Representatives. 


The gains and losses in the Senate 
were even more unusual. The Republi- 
cans gained two closely contested seats 
in Kentucky, one in West Virginia, and 
one in New York. Surprise losses of 
Senate seats occurred in Idaho and 
Colorado.!4. Senator Duff was defeated 
by ex-Mayor Clark of Philadelphia by 
approximately 17,000 votes despite a 
margin of 600,000 for the Eisenhower- 
Nixon ticket.15 Few would have pre- 


11An example of this viewpoint was the 
article, “‘The Fight for Congress’ by Charles 
B. Seib in the Harpers Magazine, October, 
1956. 

12Republican seats in the House of Repre- 
sentatives were gained in the following states: 
Connecticut, 1; Delaware, 1; Illinois, 1; 
Michigan, 1; New Jersey, 3; Pennsylvania, 1; 
and West Virginia, 2. 

13Democratic seats in the House of Repre- 
sentatives were gained in the following states: 
California, 2; Iowa, 1; Kansas, 1; Maine, 1 
in September; Missouri, 1; Montana, 1; Ne- 
braska, 1; Nevada, 1; Oregon, 2; and South 
Dakota, 1. 

144The victory of the Democrat Travis 
Church by over 47,000 votes in Idaho was a 
real surprise. Senator Welker had been a 
long-term incumbent, and he had expected to 
win readily if the Eisenhower-Nixon ticket 
won a substantial victory. The defeat of 
Republican Dan Thornton by less than 3,000 
votes in Colorado was also a surprise in view 
of the 131,000 majority of the Eisenhower- 
Nixon ticket. Colorado also elected a Demo- 
cratic Governor by over 17,000 votes. 

15Clark’s victory was an overwhelming 
170,000 majority in his native Philadelphia. 
Clark even outran Adlai Stevenson in Phila- 
delphia by 45,000 votes. 


dicted a Democratic Senate with two 
Republican senatorial victories in Ken- 
tucky, and one in traditionally Demo- 
cratic West Virginia; but of such is the 
unpredictable nature of politics.1& 


Many of the victories in the 1956 
Congressional races were very close for 
both the Democratic and Republican can- 
didates. These close elections are shown 
in Table 4. In thirteen Congressional 
Districts the Republican candidates’ mar- 
gins of victory were two percent or 
less.17 There were also thirteen Con- 
gressional districts in which the Demo- 
cratic margins of victory were two per- 
cent or  less.18 These twenty-six 
Congressional districts are truly mar- 
ginal. 


OUTLOOK FOR 1958 


House of Representatives. Rarely does 
the party which controls the presidency 
gain seats in the House of Representa- 
tives in a mid-term election. The principal 
exception to this rule of politics was 
the 1934 Congressional elections in which 
the Democratic party gained nine House 
seats. The usual loss of seats by the 
incumbent party is rather heavy (See 
Table 5.) 


The margin of victory in a Congress- 
ional district can be used as a measure 
of vulnerability. In this sense, the Re- 
publican party is more vulnerable in 1958 
than the Democratic party. In the 1956 
Congressional elections the Republican 
party won 31 House seats by a margin 
of five percent or less, the Democrats, 
30. (See Table 6.) 


In view of the 1956 Congressional elec- 


16The division of the Senate in the 85th 
Congress was the same as the 84th—that is, 
49 Democrats and 47 Republicans. The April 
2, 1956, Senatorial election in Texas was eas- 
ily won by the Democrat Yarborough de- 
spite the large number of other Democratic 
candidates seeking the office. 

The real division of the House of Repre- 
sensatives in the 85th Congress was 234 
Democrats to 201 Republicans—a gain of two 
over that of the 84th Congress. 

17Most of the twelve Congressional seats 
lost to the Democratic party in 1956 were 
safely Republican in 1954 and in 1952 (that 
is, margin of over five percent). 

18Most of the ten Democratic Congressional 
Districts lost to the Republicans were mar- 
ginal districts in 1952 and 1954 (that is, were 
won by a margin of less than five percent). 
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tions, it would appear that the best the 
Republicans can hope for is to gain sev- 
eral marginal seats. It would be a most 
unusual occurrence if the Republican 
party were to win majorities of either 
the thirty marginal Republican seats or 
of the nineteen marginal Democratic 
seats. It seems possible that the Republi- 
cans may regain several of the tradition- 
ally Republican seats lost in the 1956 
elections, and that they might win a few 
of the close Democratic seats; but this 
would not appear to be sufficient to give 
them control of the 86th Congress. In- 
deed, the Democratic party may well in- 
crease its total of House seats above 
the present 234. 


United States Senate. The outlook for 
the Republican party in the 1958 Sena- 
torial election is bleak indeed. The 
present Democratic majority of two in 
the Senate ordinarily might not be too 
difficult a barrier to overcome in a mid- 
term election. The Republican party has 
increased its Senate membership in five 
mid-term elections since 1870, while the 
Democrats have done so in only two.19 

But the nature of the 1958 elections 
for the United States Senate places the 
Republican party at a distinct disadvan- 
tage. There will be only eleven Demo- 
cratic Senators whose terms will expire. 
The Republicans, however, will have 
twenty-one Senators whose terms will 
expire. Five of the eleven Senatorial 
elections will be in states which are re- 
garded as absolutely safe and where the 
Democratic margin of victory was over- 
whelming in 1952 (Florida, Mississippi, 
Tennessee, Texas, and Virginia). In 
three of the remaining six Democratic 
states, victory appears fairly safe 
(Missouri, Rhode Island and Washing- 
ton). In only three of the eleven Demo- 
cratic states to have Senatorial elections 


19See Table 6. The 1880 election gave the 
Republicans 38 seats and the Democrats 36. 
There were two Senators from other parties. 
This election gave the Republicans control of 
the Senate. The 1890, 1898, 1902, 1906 elections 
increased the Republican majority in the 
Senate. The three seats gained by the Demo- 
crats in 1886 did not give them control of the 
Senate. The 1934 gain of ten seats increased 
the Democratic majority in the Senate, 


in 1958 was the 1952 margin of vic- 
tory below 52 percent (New Mexico, 
Massachusetts, and Montana), and there- 
fore narrow enough to be classified as 
marginal (See Table 7). Yet 1952 was 
a presidential election year; and if the 
trend that has often been evident in these 
states during mid-term elections should 
materialize in 1958, in these three states 
the Democrats could increase their 
majority.?° 

A survey of the 1952 Senatorial elec- 
tion results in the twenty states which 
elected a Republican senator emphasize 
the difficult situation which will confront 
the Republican party in 1958. Only four of 
these twenty-one Republican Senate seats 
appear to be safe (Maine, Nebraska, 
North Dakota, and Vermont). Cali- 
fornia appears less safe even though 
Senator Knowland secured 87 percent of 
the vote in 1952. This is because of 
Senator Knowland’s announcement that 
he would not be a candidate for re-elec- 
tion in 1958.21 Minnesota appears 
reasonably safe for the Republican party 
only to the extent that the incumbent 
Senator Thye won by 57.1 percent in 
1952. Yet Senator Humphrey’s victory 
by 57.2 percent in 1954 shows how a 
shift to the Democratic party can occur. 


In 1952, twelve?22 of the twenty-one 
Republican senators won their seats by 
less than 55 percent of the vote, some 
by a percentage considerably below 55 
percent. In each of these states the 
Republican candidate will be more 
vulnerable in 1958 than he was in the 
presidential year of 1952. Republican 
senators from New York and New Jersey 


20For example, in the 1954 Senatorial elec- 
tions in New Mexico, the Democratic candi- 
date received 57.3 percent of the vote. 


21However, Senator Knowland may run for 
Governor in California in 1958. This might 
have an important bearing upon the Sena- 
torial election. Senator Knowland is popular 
in California, and he could well aid the Re- 
publican candidate for the Senate. 

22These states are: Arizona, Connecticut, 
Delaware, Indiana, Maryland, Michigan, Ne- 
vada, Ohio, Pennsylvania, Utah, Wisconsin, 
and Wyoming. (See Table 8.) 

In the special election held in West Virginia 
in 1956 to complete the unfilled term of the 
late Senator Neely, Chapman Revercant (Re- 
publican) won by 54.1 percent of the vote. 
He is vulnerable in 1958. 
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are less vulnerable than in the above 
twelve states in the 1958 elections, but 
local factors, not yet evident, may affect 
these elections. 


Thus, the over-all prospects for the 
Republicans in the Senatorial elections of 
1958 do not now appear very sanguine. 
It seems evident to the writer that the 
Democratic party may well increase its 
present total of 49 to 56 or 58. The 
mathematics of this election are 
“stacked” against the Republican party. 
This is particularly true when it is con- 
sidered that the 1958 mid-term election 
will occur during the second term of the 
present Republican administration, and 
there is a tendency for the party in 
power to lose a greater number of Senate 
seats in the second mid-term election 
than in the first term. 


SUMMARY AND 
CONCLUSIONS 
In retrospect, the 1956 presidential 
elections were unusual in these ways: 
1. The Republicans increased their 


over-all percentage of victory over 
1952; 


2. The Republican party lost ground 
in 17 states—the agricultural area, 


the Far West and two Southern 
states; 


3. The Republican party made its 
greatest gain in the populous and 
industrial states; 


4. The victorious party (Republican) 
for the first time since 1848 lost 
both Houses of Congress. 


With this background the present 
prospects for 1958 Congressional elec- 
tions may be summarized as follows: 


1. The Republican party probably 
will not regain control of the 
Senate. In fact, the Democratic 
party could win enough seats to 
increase its margin; 


2. The Republican party probably will 
not regain control of the House of 
Representatives, but there is a 
possibility that it may gain a 
few seats over 1956 if the agricul- 
tural areas return to their tradi- 
tional Republicanism and the party 
holds its gains in the East. Even 
this does not appear to be a hopeful 
prospect for the Republicans at the 
present time.23 


23The 1957 Michigan local elections, and the 
1957 Texas United States Senatorial election 
may be a straw in the wind. The Democrats 
won handily in both of these elections. Any 
pent-up dissatisfactions with the national 
Republican party may be reflected in Demo- 
cratic strength on the local level. The recent 


death of Senator Joseph R. McCarthy of Wis- 
consin will not change the number of Sena- 
tors up for re-election in 1958. The difference 
in the personalities in Wisconsin will afford 
an interesting political campaign in that state 
in 1958, and it places Wisconsin in the mar- 
ginal class. 
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Attitude Survey Methodology in Industrial Relations 
by JAMES H. MULLEN* 


This article is the second of two dealing 
with attitude surveys. Its purpose is to 
describe and appraise the principal 
methods of conducting surveys currently 
used in industry and social research. It 
also deals with a number of methodo- 
logical problems common to all opinion- 
gathering techniques, including question- 
naire construction, sampling, administra- 
tion, research design, analysis and 
interpretation of results. The first article, 
which appeared in the March, 1957, 
Economics and Business Bulletin, devel- 
oped the history and background of this 
approach to opinion interchange and 
communication. 


THE attitude survey, arising as it did 
from a spontaneous demand for informa- 
tion about the thinking of people in 
varied situations, was used in an empiri- 
cal way for many years by journalists 
and other practitioners. Methodology 
received scant attention, however. In 
the last two decades several factors have 
contributed to an increased awareness of 
the importance of methodology. One of 
the most important of these was the 
failure of a number of widely published 
opinion polls to make accurate determ- 
inations of the climate of public opinion. 
Perhaps the most spectacular of these 
failures was that of the Literary Digest 
Poll which, based on incorrect sampling 
methods, predicted an overwhelming vic- 
tory for the Republican presidential can- 
didate, Alfred Landon, in 1936. Another 
factor which has contributed to the de- 
velopment of more precise techniques of 
attitude measurement has been the 
adoption and extensive use of the atti- 
tude survey technique by psychologists, 
sociologists, and other social scientists, 


*James H. Mullen is an assistant professor 
of Management in the School of Business 
and Public Administration. He is actively 
engaged as a consultant in the field of In- 
dustrial Relations and has conducted a 
number of attitude surveys for industry. 


as a means of obtaining information 
about social phenomena. In their efforts 
to obtain deeper and more meaningful 
perceptions of the dimensions of human 
attitudes and beliefs, they have developed 
a series of significant refinements of 
earlier survey techniques. Although this 
continuing trend has brought about a 
growing body of practices based upon 
the development of theory and method- 
ology, important differences of opinion 
still exist among practitioners. 


AN APPRAISAL OF THE 
PRINCIPAL METHODS 


In the preceding article in this series 
(March 1957), the term attitude survey 
was defined and the principal methods 
of surveying were described. It was 
noted that the attitude survey is con- 
ducted predominantly by means of ver- 
bal techniques, although some attempts 
have been made to elicit attitude 
responses by nonverbal techniques such 
as projective interpretations of human 
actions. It was pointed out that the 
three principal forms of verbal survey 
are the personal interview, the written 
questionnaire, and the attitude scale. A 
distinction was also made between the 
systematically or rationally constructed 
attitude scale and the more simple, 
single question opinion poll. Finally, 
the attitude survey, as it is characteristi- 
cally used in the field of industrial rela- 
tions, was evaluated in terms of the 
above analysis. It was concluded that 
the industrial relations survey lay some- 
where between the rational attitude 
scale and the single question poll, pos- 
sessing some of the characteristics of 
both. Like the single question poll, the 
questions included in the survey are 
selected on an arbitrary rather than a 
systematic or rational basis. Unlike the 
single question opinion poll, however, 
most attitude surveys in this field con- 
tain a number of questions which may 
be designed to gauge the nature of a 
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single phase or many phases of human 
relationships. Unlike attitude testing in 
certain other fields, that used in indus- 
trial relations usually attempts to ascer- 
tain attitudes toward a number of dif- 
ferent practices and areas rather than 
toward a single concept. 


A considerable controversy has arisen 
between the proponents of the attitude 
scale and those who would use more 
simply constructed oral or written ques- 
tionnaires. Both methods for ascertain- 
ing attitudes have advantages and limi- 
tations, which prompts some discussion 
at this juncture. A more meaningful 
analysis of the pros and cons of both 
methods can be made, however, after 
some explanation of their nature. 


The scalar technique of attitude ques- 
tionnaire construction has been used by 
psychologists for the past 25 years. It 
represents an attempt to improve on the 
validity of earlier questionnaire tech- 
niques, particularly that of the single 
question opinion poll. While attitude 
scales vary in method of construction 
and presentation, they have certain com- 
mon characteristics. Essentially, the 
sealing technique requires that the par- 
ticipant indicate an expression of agree- 
ment or disagreement, approval or 
disapproval, with respect to a series of 
statements which confront him on the 
questionnaire. 


The statements on the attitude scale 
have been carefully selected and stand- 
ardized in an effort to present a con- 
tinuity of opinion or attitude from 
extreme favorableness to extreme un- 
favorableness. Thus, the acceptance of 
some and the rejection of others tend 
to indicate the degree to which the indi- 
vidual’s attitude toward the subject in 
question is favorable or unfavorable. 
These scales usually include from ten to 
thirty statements which have been 
selected from a much larger number. 
The selection is based on the opinions 
of a number of qualified individuals who 
read each statement carefully and place 
it in one of ten or eleven piles accord- 
ing to their judgment as to the favora- 


bleness or unfavorableness of the state- 
ment. The position assigned to each 
statement is recorded for each individual 
and the total array of positions is exam- 
ined to determine how consistently an 
item is placed in a given pile. If there 
is little or no agreement between the 
judges as to the proper position of the 
statement, that is, if the item has been 
assigned with equal frequency to a large 
number of different piles, then it is 
discarded as being too ambiguous. If, 
however, it has been assigned con- 
sistently to the same pile or to piles 
near each other in the continuum, then 
it may be presumed with safety to be a 
fairly clear expression of a certain de- 
gree of favorableness or unfavorableness 
of attitude toward a given subject. The 
median or mean position assigned to an 
item by the various judges determines 
the numerical value of the item. The 
average of the values for each of the 
items selected by the respondent de- 
termines the numerical value of his 
attitude toward the subject. 


The method described above was first 
developed about 1930 and published by 
L. L. Thurstone and his associates. Im- 
portant additions and variations were 
contributed to the scalar method by E. S. 
Bogardus, R. Likert, and L. Guttman, all 
of which bear their authors’ names. All 
of these methods, however, are essen- 
tially similar in their approach to the 
problem of measuring attitude, and all 
utilize some rational or objective tech- 
nique for determining the degree of 
favorableness or unfavorableness of the 
statements included in the scale. 


The advantages claimed for the scalar 
method of construction stem from the 
improvement which it represents over 
the single question opinion poll. The 
scalar method is believed to yield a 
higher degree of accuracy and reliability 
than the single question technique. The 
presumption is that the consistency of 
results will be increased if ambiguity is 
minimized, that is, the same question will 
convey more nearly the same concept to 
large numbers of respondents and hence 
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will yield more consistent reactions from 
individuals with the same or similar atti- 
tudes. The device referred to above for 
obtaining consistent or reliable results 
and avoiding the inclusion of ambiguous 
statements or questions, factor or item 
analysis, is used in connection with the 
Thurstone Scale and with other similar 
types. Since the questions chosen for 
inclusion in the single question poll are 
determined arbitrarily or subjectively by 
one er a relatively small number of per- 
sons, avoidance of ambiguity depends 
almost exclusively on the common sense 
and personal experience of the person or 
persons designing the scale. 


Another claim of the proponents of 
the scalar method is that it minimizes 
the problem of bias due to the form of 
the question and answer. The attitude 
is determined by the selections of the 
respondent from a continuum of state- 
ments which include all degrees of 
favorableness and unfavorableness. The 
single question poll, in contrast, relies on 
the development of questions which are 
neutral in their phraseology as a means 
of preventing the respondent from being 
led to a particular answer. While the 
intention of those constructing the poll 
may be above reproach, it is often dif- 
ficult to prevent a “leading” quality from 
creeping into questions through inad- 
vertence. 

Another problem of attitude measure- 
ment is that of unidimensionality, that 
is, the measure of one attitude as con- 
trasted with different attitudes held by 
different people. A statement such as, 
“the Federal Government should have the 
right to require compulsory arbitration 
of all labor disputes involving the public 
welfare,” for example, might elicit 
agreement or disagreement from the 
respondent based on his attitude toward 
the centralization of power in govern- 
ment, the institution of collective bar- 
gaining, the effectiveness of third party 
intervention, or the necessity of eliminat- 
ing labor disturbances. Thus this ques- 
tion, used by itself in an opinion poll 
would not guarantee the measurement of 


an attitude toward a single social ques- 
tion, but might elicit responses by dif- 
ferent persons to entirely different social 
issues. In order to assure that only one 
subject area is being measured, it would 
be necessary to include a considerable 
number of additional questions which 
would not reflect the multiple attitudes 
or beliefs covered by this question. 
While the degree of unidimensionality 
cannot be established with perfect pre- 
cision for the attitude scale technique, 
there are methods which may be used to 


determine with some degree of relia- | 


bility the presence or absence of this 
quality in the Thurstone and Likert 
scales and in others of similar cohstruc- 
tion. In the case of the single question 
opinion poll and other attitude surveys 
which do not utilize systematic bases for 
the selection of questions or the deter- 
mination of scale values for the com- 
ponent questions, no methods are 
available for systematically testing the 
unidimensionality of the questionnaire. 


The case of the attitude scale tech- 
nique has been ably stated by Professor 
Quinn McNemar in his comprehensive 
survey and review of opinion-attitude 
methodology.1_ He summarizes his con- 
clusions in these words: 


We have no hesitancy in making our 
second proposal, namely, that single 
question opinion gauging be discarded 
in favor of opinion measurement by 
attitude scales. By using scales, a 
satisfactory degree of reliability (ac- 
curacy) can be obtained. By factorial 
analysis or preferably by the Guttman 
scaling method, unidimensionality can 
be guaranteed. There is evidence that 
scaling automatically takes care of the 
intensity factor. Validity would have 
to be established, but this is no more 
difficult for scales than for single ques- 
tions; and with a higher reliability, 
the validity is more meaningful when 
a single dimension is involved. The 
whole weariness problem of bias due 
to question and answer form nearly 
vanishes ..... 

There are additional advantages to 
measuring opinions by scales. By their 
use the social scientist is less apt to 


1Quinn McNemar, “Opinion-Attitude Method- 
ology,’’ Psychological Bulletin, Volume 43, 
No. 4, July, 1946, p. 327. 
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be misled or to mislead others with 
percentages. He has a more accurate 
instrument for classifying people into 
categories. He can, for example, segre- 
gate the upper or lower 30 percent 
with some assurance that the included 
individuals have been fairly reliably 
placed therein; by breakdowns on other 
variables he can make as meaningful 
analyses as are possible with the 
single yes-no question; he can use the 
distributed scores in his analytical 
work and thereby be able to express 
the closeness of relationships in an 
exact manner; and predictions can be 
more easily made from scaled ques- 
tions. 

Few persons who are familiar with 
attitude and opinion research method- 
ology will care to dispute the obvious 
superiority of the attitude scale to that 
of the single question poll when it comes 
to precision of measurement. There are, 
however, other considerations which 
seem to militate against the use of the 
attitude scale technique. For example, 
there are practical limitations of time 
which would minimize the usefulness of 
a large battery of questions, all aimed 
at the measurement of a single attitude 
or opinion. When one sets about to 
measure attitude on the effectiveness of 
programs and policies which are of some 
complexity, or where one is interested 
in obtaining opinion on a number of 
political, social, or economic uses, it is 
necessary to determine the individual’s 
attitude on a considerable number of 
different subjects. To do this with the 
scalar technique, it would be necessary 
to use an equally large number of atti- 
tude scales. Since this is usually im- 
possible for a number of practical rea- 
sons, particularly the time element and 
the cost involved, the only alternative is 
to narrow the scope of one’s inquiry 
considerably. As Messrs. Krech and 
Crutchfield? observe in their review of 
this problem: 

One cannot afford the luxury of ob- 
taining high reliability of a single 
measure at the cost of not obtaining 
other essential data from the indi- 


2David Krech and Richard S. Crutchfield, 
Theory and Problems of Social Psychology, 
New York McGraw-Hill Book Company, 
1948, p. 275. 


vidual. Without such varied data from 

each respondent, correlational analysis 

is impossible, and the meaningfulness 

of a single measure becomes dubious. 

Another practical limitation of the 
scalar method is that it yields only one 
value indicating the degree of favor or 
disfavor of the respondent toward a par- 
ticular issue. In the case of a scale used 
to measure employee attitude, for ex- 
ample, it only permits the measure of 
the degree of satisfaction or dissatisfac- 
tion which the employee exhibits toward 
the company. It does not identify the 
various causal factors or conditions 
which determine the level of the employ- 
ee’s morale. It has limited value, there- 
fore, to the company management which 
desires to take steps to remedy and 
change specific policies, practices, pro- 
grams, or personnel which may be 
required. 


Another very practical problem con- 
fronting organizations which desire to 
utilize a standardized attitude scale for 
a survey of their own personnel is that 
of adapting the scale to fit their indi- 
vidual needs and interests. Changes in 
words, the substitution of one statement 
for another or the addition of new state- 
ments cannot be made without destroying 
the internal balance of the attitude scale. 
Unless additional factorial analysis is 
undertaken for a modified scale, the in- 
ternal consistency of the scale can no 
longer be presumed to exist. This means, 
in effect, that the attitude scale cannot 
be adapted or modified without losing its 
principal advantages of reliability and 
precision. The alternatives are using the 
attitude scale as it is or incurring con- 
siderable expense in developing a new 
scale or series of scales specifically de- 
signed for the use of the individual or- 
ganization. In most instances, the latter 
procedure appears to be too costly. 
Standard attitude scales are available 
commercially and have been used by a 
number of organizations. For the most 
part, the generalized nature of these 
scales limits their usefulness to little 
more than the broad dimension of atti- 
tude or morale within the organization. 


a 
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It does not permit the organization to 
inquire about the opinions of the indi- 
vidual or specific programs or policies. 

By way of summarizing the case for 
the opinion poll type of questionnaire, 
Professor Leo P. Crespi has written a 
rejoinder to the McNemar paper which 
appears in a later issue of the Psycho- 
logical Bulletin: 


McNemar confesses to no hesitance 
in making the proposal that single 
question opinion gauging be discarded in 
favor of opinion measurement by attitude 
scales. Such a stand cannot fail to 
impress most students of polling, even 
those most critical of its present weak- 
nesses, as throwing out the baby with 
the bath. The additional thought will 
occur to some that such an action is 
not so much an oversight as great 
affection for another infant. McNemar 
endeavors to forestall the obvious re- 
joinder to his position with the fol- 
lowing statement: 


If it is objected that a given prob- 
lem does not justify the extra work 
entailed in scale construction and the 
added schedule — administration time, 
there is reason to suspect that the 
problem isn’t of much value from a 
rigorous scientific viewpoint. 


Much that is questionable can hide 
behind this persuasive sounding claim. 
McNemar’s_ unhesitating suggestion 
would seem to imply that the bulk of 
AIPO, Fortune, and NORC material is 
of little value. Taken together with 
his repeated insistence upon the utmost 
rigor in investigation, McNemar’s posi- 
tion reveals a definite misconception. 
He makes the perfectionist’s error, 
possibly an occupational disease with 
methodologists, of singletrackedly 
seeking to maximize precision in scien- 
tific experiments. Is not the proper 
function instead to maximize results 
per unit of effort? It is easily pos- 
sible that the increase in information 
to be obtained with the substitution of 
expensive laborious scales for the 
single question is relatively small and 
. far out-weighed by the increase in 


McNemar’s emphasis upon methodo- 
logical and statistical refinement would 
seem to excommunicate a whole new 
area of modern statistical development 
which is concerned with the fashioning 
of relatively imprecise statistics which 
are, however, of remarkable efficiency 
in terms of the information obtainable 
per unit cost in time and money. What- 
ever may be the inclination of the 


methodologist, the concrete researcher 
knows well that his yardstick of suc- 
cess in experimentation must be 
efficiency—the results per unit of cost. 
Over preoccupation with refinement 
can be just as sterile in science as in 
social life. 


Depth Interviewing 


Comparisons are often made by those 
concerned with opinion-attitude measure- 
ment as to the relative merits of the 
opinion poll question and depth inter- 
view questioning technique. The pro- 
ponents of the depth interview method 
correctly point to the superiority of 
depth interviewing in detecting mis- 
understandings of the meaning or intent 
of the question. As the responses 
elicited by the initial question begin to 
pour forth, there is usually ample op- 
portunity for the interviewer to per- 
ceive from the nature of the answers, 
whether or not the question has been 
correctly understood and _ interpreted. 
If not, the interviewer will have the 
opportunity to clarify the concept with 
additional questions or explanations. 
Depth interviewing also enables the in- 
terviewer to form opinions concerning 
such factors as intensity, saliency, 
specificity, precision, and sincerity of the 
answers. Neither the attitude scale nor 
the single question poll type survey pro- 
vides such opportunity for ascertaining 
such qualitative factors. For these and 
other reasons, the depth interviewing 
technique is considered to be superior 
to the various “paper and _ pencil” 
methods and to the single question as 
used in personal interviews. 


The limitations of the depth interview- 
ing method, however, are considerable, 
and have acted as major deterrents to its 
use in the majority of industrial rela- 
tions’ situations and in testing public 
opinion. The most important practical 
limitations are those associated with its 
relatively great expenditure of time and 
money. The usual depth interview is, 
itself, a fairly time-consuming affair 


3Leo P. Crespi, “Opinion-Attitude Method- 
ology and the Polls—A Rejoinder,” Psycholo- 
gical Bulletin, Volume 43, No. 6, November, 
1946, p. 566. 
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requiring at least an hour. This means 
that unless a large number of trained 
interviewers are available, the process 
will cover a considerable period of time 
and probably will preclude the polling of 
all of the group being studied. This 
introduces problems of sampling and 
gives rise to the other limitations which 
are inherent in any fractional study. 
There are also the problems of obtain- 
ing and training competent interviewers. 
The validity of the findings are in large 
measure dependent upon the quality of 
interviewing and interpretive analysis on 
the part of those conducting the inter- 
view. Needless to say, competent inter- 
viewers are difficult to find and represent 
a very significant factor in the cost of 
such a survey. Limitations of time and 
space also increase the difficulties in- 
volved in conducting such studies over 
a wide geographical area. Thus, regional 
or national studies are severely handi- 
capped in most cases if the personal 
interviewing technique is to be used. 


The above and other limitations, in- 
cluding possible interviewer bias, have 
militated against the use of the depth 
interview technique in most situations in 
industry. A growing number of com- 
panies, however, are utilizing this tech- 
nique in conjunction with written ques- 
tionnaires on a subsample of those 
covered by the former method. They 
have been used also as a pretesting tech- 
nique to check the applicability and com- 
prehensibility of questions, and as a 
post-survey technique for checking the 
validity of findings. 

It appears, then, that from the stand- 
point of cost, convenience, versatility, 
and ease of subject area coverage, the 
single question poll technique holds a 
decided advantage over the attitude 
scale and the depth interview method. 
Its most serious limitations, those re- 
lating to its validity and reliability due 
mainly to ambiguity and multiple ques- 
tion interpretation, are minimized or, at 
least, mitigated when the poll type ques- 
tion is used with a series of other 
questions which deal with similar or re- 


lated areas and when the group being 
surveyed is fairly homogeneous and 
reasonably well-acquainted with the sub- 
ject areas of the survey. 


This is not to imply that high validity 
and reliability can be assured simply by 
adding more questions dealing with dis- 
similar or different topics. On the other 
hand, a questionnaire which contained 
six or seven questions dealing with 
various phases of an employee’s relation- 
ship to his foreman would give a more 
valid and reliable picture of that em- 
ployee’s general attitude toward his fore- 
man than a questionnaire which con- 
tained only one question dealing with 
this topic. Finally, precise measurement 
of employee attitudes is not essential 
for management’s purposes. Rough 
approximations will indicate the areas 
in need of attention. 


PROBLEMS OF 
QUESTIONNAIRE CONSTRUCTION 


Although a number of problems of 
attitude survey construction, administra- 
tion, and interpretation are common to 
all types of survey techniques, primary 
reference in the following discussion will 
be made to those associated with the 
multiple-question, written questionnaire 
which is used most frequently in the 
field of industrial relations at the 
present time. 


One of the first questions to be con- 
sidered in constructing an attitude sur- 
vey questionnaire is that of general re- 
search design. Unfortunately, the ques- 
tion of survey or research design is 
often completely overlooked with the 
consequence that the summaries are 
simply countings of a series of unrelated 
questions and topics. Professor Katz, 
in a paper given before the Industrial 
Research Association in 1949 presented 
the issue with unmistakable clarity:4 


On the technical side, the most com- 
mon practice in surveys is a lack of 


4Daniel Katz, “Good and Bad Practices in 
Attitude Surveys in Industrial Relations, 
Measurement of Employee Attitudes,” Pro- 
ceedings of Annual Meeting, Industrial Rela- 
tions Research Association, New York City, 
1949, p. 212. 
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research design even when basic 
theoretical concepts are not being in- 
vestigated. Apart from the signifi- 
cance of the theory under investiga- 
tion, surveys can be considered from 
the point of view of the methodologist 
in relation to the adequacy of the re- 
search design. The fact of the matter 
is that the empiricism of market 
research has so affected the survey 
field that it is all too common prac- 
tice to find industrial surveys with 
almost complete lack of research de- 

There is little systematic 

attempt to seek relationships so that 

repeated studies will build up a field 
of knowledge. 

To take a simple example, if we 
make a study of the attitude of fore- 
men, we should so design the survey 
that we can begin to get answers about 
some of the factors related to the dif- 
ferences in the management-identifica- 
tion of foremen. One suggestive study 
has related foremen philosophy to the 
length of time on the job and has 
demonstrated that the longer the fore- 
man has been in his role of manage- 
ment representative, the more he takes 
over management values..... By 
survey design, then, is meant the 
attempt to establish a relationship be- 
tween two factors. A good survey 
procedure calls for design even if the 
problem under investigation is at the 
applied level. 

The possibilities for factor correlation 
of some kind are, of course, endless, 
and limitations of cost and time prevent 
any survey from utilizing too many of 
them. As Professor Katz has cautioned, 
however, it is essential that some 
thought be given to this problem before 
launching a survey if the probability of 
producing a set of data which are am- 
biguous or meaningless is to be avoided. 
It would seem to be essential for the 
survey designers to consider this prob- 
lem carefully in light of the purposes 
and objectives of the survey. 

The choice of control questions would, 
of necessity, be based on experience and 
a priori knowledge of the probable causal 
elements at work in the environment or 
area being studied. Since, in all proba- 
bility, limitations of time and budget 
would preclude the use of a great num- 
ber of control questions, the subjective 
insights of the survey designers and the 


knowledge of the primary objectives of 
the study would be most important in de- 
termining those to be included and those 
to be discarded. In effect, therefore, the 
whole problem of survey design seems to 
rest on the principle that a much more 
meaningful survey can be conducted if 
certain research hypotheses are formu- 
lated or considered and provision is made 
in the design of the survey for the test- 
ing of these hypotheses. Furthermore, 
while a priori knowledge and human in- 
sight may lead to incorrect hypotheses 
or the omission of important ones, it is 
better to attempt to test these hypothe- 
ses than to simply collect and measure 
fact and opinion for which no relation- 
ships are apparent or established. As 
Professor Katz has noted, these princi- 
ples are equally applicable to applied and 
theoretical research problems. 

Another problem of considerable im- 
portance in constructing a questionnaire 
is that of determining whether questions 
are clearly and not ambiguously worded 
and whether the questions have the same 
meaning to everybody. Some provisions 
should be made to test the wording of 
questions prior to their use in the sur- 
vey. There are two possible approaches 
to this problem. One seems to be the 
use of a fairly standardized question- 
naire which has been developed and 
tested by a survey specialist. Presuma- 
bly, the accumulated experience of the 
specialist has been brought to bear on 
the problem so that the content and 
phraseology of the questionnaire has 
been revised and refined to eliminate any 
ambiguous statements or questions. 


When questionnaires are being initially 
constructed, however, some form of pre- 
test or pilot study would seem to be 
advisable. Some organizations have 
utilized informal methods of pretesting 
such as asking a number of possible 
respondents to read and criticize the 
tentative questionnaires; others have 
used a “panel of experts” approach in 
which initial phraseology of questions 
is submitted to roundtable discussion re- 
lying on the concensus of the group as 
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to whether the wording, construction, and 
meaning of the question is readily under- 
standable or in need of revision. It 
would seem, however, that the most re- 
liable method of pretesting the survey 
questionnaire is through the medium of 
a formal pilot survey. In such a survey, 
the preliminary test form would be ad- 
ministered to a small group of respond- 
ents who would be asked to indicate 
questions that they had difficulty in un- 
derstanding and who would probably be 
further questioned through personal in- 
terviews to obtain their impressions and 
criticisms of the questionnaire. Similar 
interviews may be of value in discover- 
ing areas where exploration is needed 
prior to drawing up the first draft of 
the questionnaire; in this way provision 
can be made for questions concerning 
topics and issues of importance which 
might otherwise have been completely 
overlooked. The substantial expendi- 
tures of time and money involved in an 
extensive pretesting or pilot study, how- 
ever, particularly one utilizing depth 
interviewing, usually militates against 
its use in practical operations where 
money, staff, and time are limited. This 
is unfortunate because skillful and 
judicious use of pretesting techniques 
may result in important improvements 
in research design, clarity of expression, 
and method of presentation and analysis. 


The accumulated experience of a large 
number of organizations in the conduct- 
ing of attitude surveys both in industry, 
marketing, and other fields has led to 
wide recognition and acceptance of cer- 
tain basic procedures in questionnaire 
construction. Although circumstances 
and needs in particular situations may 
render departure from one or more of 
these rules-of-thumb procedures neces- 
sary and desirable, they nonetheless con- 
stitute points of departure which must 
be considered in the construction of the 
attitude questionnaire. Some discussion 
of these aspects of questionnaire con- 
struction appears to be desirable in order 
to indicate problem areas and possible 
solutions. 


One of the basic problems in question- 
naire construction is that of the number 
of topics or subject areas to be covered. 
In recent years there seems to have been 
a general tendency for organizations 
conducting attitude surveys to increase 
the number of topics or subject areas 
covered by the industrial questionnaire. 
This may possibly be explained by a 
growing recognition on the part of man- 
agement officials and others sponsoring 
attitude surveys of the potential contri- 
bution of the survey technique in 
uncovering information about important 
and critical issues within the organiza- 
tion. Those officials reason that as long 
as the survey is being administered and 
as long as the answers obtained are 
valuable, why not find out how the sur- 
vey group feels about “such and such 
an issue as well as these other issues.” 
So the questionnaires grow in their 
coverage. 


While the desire to find out about as 
much as possible is understandable and 
laudable, there are certain very real 
dangers inherent in increasing the size 
and coverage of the questionnaire. Many 
organizations have attempted too am- 
bitious and extensive a coverage of topics 
in surveys of their employees. As the 
number of topics or issues is increased, 
the general tendency is both to increase 
the number of questions in the question- 
naire and decrease the number of ques- 
tions dealing with a particular topic or 
issue. Both of these procedures are 
dangerous when carried to extremes. 
While the optimum number of questions 
to be included in the questionnaire will 
vary depending upon a number of factors 
such as the educational level of the group 
surveyed, the complexity of the subject 
material covered and the methods of 
presentation used, there would seem to 
be a practical limit dictated by the ex- 
penditure of time and effort required 
on the part of the respondent. In the 
case of most industrial surveys carried 
on by individual companies, the employ- 
ees as a rule are genuinely interested 
in the topics being covered since their 
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job is a matter of major concern to them. 
Moreover, they are usually adequately 
briefed on the objectives of the study. 
Under these circumstances a number of 
companies have successfully used as 
many as 100 questions. In most cases, 
however, 50 to 75 questions seems to 
be a more reasonable number. The Con- 
ference Board survey reports two com- 
panies that used more than 150 ques- 
tions.5 The dangers of asking too many 
questions are many. The respondents 
lose interest and become mentally tired 
before they have completed the ques- 
tionnaire. The probable results are that 
a large number of questionnaires will 
not be completed or that the answers 
to questions appearing in the later pages 
of the questionnaires will be superficial 
and unreliable, having been disposed of 
with increasing impatience and decreas- 
ing attention. 

The other approach, that of decreasing 
the number of questions for each topic 
or area covered, can also have a detri- 
mental effect upon the quality of the 
survey. Carried to the extreme, the 
questionnaire becomes a compilation of 
individual questions covering a wide 
number of unrelated issues. This places 
an increasing burden on the mental 
agility of the respondent. He is re- 
quired to adjust his thought processes 
from one conceptual frame to another in 
rapid succession. As a consequence, the 
questions are less fully comprehended 
and hence more ambiguous, with the re- 
sult that the answers are less reliable 
and less meaningful. 


Another problem associated with that 
of the growth of the questionnaire is 
that of the costs of preparation and 
analysis. While preparation costs do 
not increase in direct proportion to the 
number of questions included, there is 
some significant increase particularly in 
the costs of analysis and presentation; 
perhaps the most important factor here 
is the degree of analysis undertaken and 


5“EXxperience with Employee Attitude Sur- 
vey,” National Industrial eae Board 
Personnel Series, No. 115, 


the number of intercorrelations under- 
taken. 


Notwithstanding the limitations dis- 
cussed above, individual companies seem 
to prefer a survey covering a relatively 
large number of topics rather than one 
concentrating on one or two. The 
National Industrial Conference Board 
report showed that of the 111 com- 
panies surveyed, 74 or 66.7 percent cov- 
ered a wide variety of topics, 29 or 
26.1 percent covered several but not a 
wide variety, and only eight or 7.25 per- 
cent covered only one or two.6 In the 
case of regional or national surveys, 
however, the tendency seems to have 
been to limit surveys to a small number 
of topics and a correspondingly small 
number of questions. This might pos- 
sibly be explained by the use of the per- 
sonal interview technique and _ the 
weaker motivation of the casual res- 
pondent. 


One of the principal areas of atten- 
tion, and one to which much time and 
effort are directed, has to do with the 
phrasing of the individual questions. 
Again, there are in particular situations 
a number of considerations which will 
lead to significant variation in the form 
and complexion of the questions. Certain 
rules, however, have almost axiomatic 
application in the development of clear, 
interrogative expression. The following 
procedures are generally considered to 
be good practice: 

1. Use simple, common words. When- 
ever there is any question about 
the level of verbal comprehension 
of the responding group, it seems 
safer to choose those words which 
most simply express the thoughts 
to be conveyed. The use of the 
word good, for example, is to be 
preferred to synonyms such as ad- 
vantageous, commendable, gratify- 
ing, etc. This procedure occasion- 
ally presents a problem where 
vocabulary simplification causes 


some sacrifice in the precision of 
meaning. These cases should be 
settled on their individual merits. 
2. Use words which are common to 
the industry or occupational group 


6Ibid., p. 15. 
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being surveyed. This practice is 
helpful in conveying more precise 
connotations, so long as the group 
is a relatively homogeneous one. 

3. Avoid compound questions. Such 
questions as, “Does your company 
pay wages that compare favorably 
with other companies in the indus- 
try and other companies in your 
geographical area?” should be 
avoided because they are essentially 
two different questions. The res- 
pondent whose pay compares 
favorably with that paid by other 
companies in the geographical area 
but is below the average for other 
companies in the industry is at a 
loss as to how to respond to this 
question. 

4. Use a mode of expression which 
is as informal as is consistent with 
good taste. Such expressions as 
“pat on the back,” “take a stand” 
or “back you up” may be preferable 
to more formal expressions of those 
thoughts because of their familiar 
connotation. 

5. Use brief, concise expression. The 
use of such phraseology as, “In 
your opinion, does the company 
delegate to you the proper amount 
of authority commensurate with 
the responsibilities which are 
usually encountered in the perform- 
ance of your job?” should be 
abandoned, in favor of a more sim- 
ple statement such as, “Are you 
given enough authority to meet the 
responsibilities of your job?” 

6. Do not use leading questions. A 
uestion such as “Are you satis- 
ed with the company’s wage policy 

of paying above the average of 
other firms in the area?” will not 
lead to valid or reliable answers. 


There are, in addition, other procedures 
which tend to increase the effectiveness 
of the survey technique. Common sense 
precautions such as allowing ample 
space for questions and for write-in 
comments, preparation of clear, legible 
typography, avoidance of unexplained 
symbols or numbers on the questionnaire 
form, etc., will improve the performance 
of the survey group and lead to more 
satisfactory results. 


There are other aspects of ques- 
tionnaire construction techniques, how- 
ever, upon which there is a difference of 
opinion and practice. For example, 
practice varies considerably as to the 


location of key questions, that is, ques- 
tions which supply the data on which 
breakdowns will be developed when 
questionnaires are analyzed. Some 
questionnaire experts feel that these 
vital statistics—age, education, marital 
status, length of time on the job, etc.— 
should be placed at the beginning of 
the questionnaire so that these questions 
which are easy to answer will form an 
introduction to the survey proper. It 
is also felt that respondents will want 
to know just how much personal infor- 
mation will be required before they 
answer the topical questions. Others 
feel, however, that the initial position 
of such questions will arouse undue sus- 
picion before the respondent has had an 
opportunity to see what the survey 
contains and so should be placed at the 
end of the survey. 


Another point at issue is whether to 
use yes-no questions or multiple choice 
responses. The advocates of the yes-no 
approach argue that this method makes 
possible a much clearer and more simple 
expression of the problem and does not 
force upon the respondent the sometimes 
confusing problem of determining the 
extent of his agreement or disagreement. 
The adherents of multiple choice ques- 
tions stress the importance of obtaining 
as accurate a statement of opinion as 
possible. They argue that the preponder- 
ance of attitude or opinion usually lies 
between the two extremes of agreement 
and disagreement and that a dichotomy 
of opinion will not reveal the respond- 
ent’s true attitude. Further, they argue 
that certain questions, such as, “Is your 
company fair in its treatment of its em- 
ployees?” are not susceptible to a “yes” 
or “no” answer. These questions con- 
fuse the respondent because they force 
upon him an absolute choice. While this 


objection may be overcome in part by the 
use of various qualifying adjectives in 
the statement of the question, the results 
are not always entirely staisfactory. It 
is also noted that the yes-no method 
tends to obscure or hide differences be- 
tween the component groups (units, 
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sections, etc.) comprising the larger 
survey groups. Many survey experts 
consider the measurement of these dif- 
ferences to be one of the meaningful 
products of the attitude survey technique. 
There is also disagreeinent as to the 
number of multiple responses that a 
given question should provide. Some 
survey designers claim that three al- 
ternatives are sufficient—one favorable, 
one neutral, and one unfavorable. They 
argue that to use more is to force 
respondents into artificial distinctions 
in attitude which do not exist in their 
conscious perceptions. Other experts 
prefer to use four alternatives, two fall- 
ing on either side of the neutral position. 
They maintain that there are real and 
significant differences in the degree of 
favorableness and unfavorableness of 
attitudes but that few, if any, persons 
who have become acquainted with any 
issue or topic remain really neutral in 
their attitudes. A third group maintains 
that a neutral response or reaction must 
be included along with the four alterna- 
tives which distinguish degrees of 
favorableness and unfavorableness. They 
argue that a significantly large com- 
munity of opinion remains essentially 
neutral or undecided about certain issues 
and that the elimination of a neutral 
statement forces this group to take one 
side or the other of the issue. Very 
few attitude surveys have attempted to 
distinguish more than five degrees or 
levels of response toward a given issue. 
Those who believe that there is an up- 
ward bias in attitude responses some- 
times advocate an unequal or asym- 
metrical distribution of alternatives. 
This arrangement distinguishes a great 
number of levels of favorable rather than 
unfavorable opinion or attitude. 


Experts disagree over the inclusion of 
an “I don’t know” or “I have no opinion” 
alternative. Those who would use it 
argue that without it all respondents are 
forced to take some position on every 
issue even though they might not be 
acquainted with or have an opinion or at- 
titude about a particular subject or issue. 


This, they argue, generates a false im- 
pression of the clarity and saliency of 
attitude about a given issue and increases 
the unreliability of the responses. Those 
who argue against its inclusion claim 
that the “I don’t know” or “I have no 
opinion” alternative permits an easy 
“out” for those people who are too lazy 
to use their minds. They point out that 
a lack of information on certain factual 
questions may be provided for by the 
inclusion of an occasional “I don’t know” 
alternative, but that its use should be 
minimized because it encourages non- 
participation on the part of the respond- 
ent. They also counter that if the sur- 
vey is properly designed, the questions 
will deal with issues and subjects which 
are close to the experience of the 
respondents and should therefore pro- 
perly evoke attitudinal reactions. 


Another point at issue is that of the 
length of the statement versus the 
length of the answer or response. The 
majority of experts seem convinced that 
the issue or subject is best presented 
as a completed or nearly complete 
thought in the body of the statement. 
This tends to make the statement longer, 
but permits the alternatives to be one 
word or a relatively small number of 
words. By not having to repeat the gist 
of the thought in each alternative 
response, the number of words is held 
to a minimum and the reading time is 
therefore reduced considerably. Those 
who argue for the longer response which 
contains part or all of the substance of 
the question maintain that repetition of 
the subject matter in the alternative an- 
swers tends to fix the issue more firmly 
in the mind of the respondent. 

Another technical problem of survey 
construction is that of minimizing or 
avoiding the possibility of primacy of 
effect in the responses. It is a widely 
recognized fact that there is a tendency 
among those who have difficulty reading 
to answer a preponderance of questions 
by checking the first or second alterna- 
tive. This tendency is also observed 


where respondents are not willing to 
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read questions carefully for other 
reasons. It can be minimized, or at least 
easily detected, by staggering the order 
of alternative replies to the questions. 
Thus, the alternative responses to ques- 
tion one would range from most favorable 
to least favorable; those to question two, 
from least favorable to most favorable, 
and soon. Some suggest that this should 
be in a random rather than a regular 
pattern so as to prevent the respondent 
from growing accustomed to any regu- 
lar rhythm or pattern. This practice, 
however, introduces some _ additional 
problems in the transcription and tabu- 
lation of results, and so it is usually 
avoided. 


While most questionnaire designers 
agree that some provision should be 
made for write-in responses, there is a 
considerable difference in opinion as to 
how and where to make provision for 
this in the questionnaire form. Some 
questionnaires provide space below each 
question for write-in statements; some 
provide it periodically throughout the 
questionnaire, usually at the end of a 
topical section or subsection; while still 
others prefer to provide space only at 
the end of the questionnaire. The prac- 
tice of asking for comments after each 
question is believed by many to fatigue 
and discourage the respondent early in 
the questionnaire and to lengthen unduly 
the number of pages. On the other hand, 
making provisions for written comments 
only at the end of the questionnaire pre- 
vents the respondent from noting his 
reactions while individual topics are still 
fresh in his mind and, therefore, pre- 
cludes most of the detail about specific 
issues. A reasonable compromise seems 
to be that of providing space at the end 
of each section or subject area. 


There is also some difference of 
opinion over the practice of grouping 
questions dealing with similar or related 
issues or topics versus distributing them 
in a random order throughout the ques- 
tionnaire. Advantages are claimed for 
both methods. Random order tends to 
reduce the possibility of the “halo 


effect” but tends to require greater men- 
tal agility on the part of the respondent 
who is forced to change his frame of 
reference with each successive question. 
If this exercise becomes too taxing, the 
respondent may lose interest in the ques- 
tionnaire and become careless in his 
answers. 


There are, of course, other questions 
relating to survey construction which 
must be dealt with in designing the for- 
mat. Some of these, such as the use of 
declarative versus interrogative sen- 
tences seem to be largely a matter of 
taste; others such as the maintenance of 
the respondent’s anonymity have become 
matters of almost unanimous agreement. 
The foregoing analysis has attempted to 
suggest only the more prominent aspects 
and problems of survey construction. It 
does not presume to have exhausted the 
list. 


PROBLEMS OF 
SAMPLING 


One of the most important aspects of 
survey design is that of determining the 
size and composition of the survey 
group. Another is insuring that this 
group is adequately polled or studied. 
Where the survey group is very large, 
it may be necessary to devise some 
method of sampling the statistical uni- 
verse, that is, the total number of per- 
sons in the survey group. In that event, 
the survey designer must select a sample 
which will be representative of the entire 
group. In the field of industrial rela- 
tions, the great majority of attitude 
surveys have been conducted within in- 
dividual plants or companies, and the 
managements of most of the companies 
have usually concluded that the ad- 
vantages of full employee participation 
more than outweigh the additional ex- 
pense involved in a survey of the total 
group. A National Industrial Confer- 
ence Board survey of over 100 companies 
showed that 92 percent of the companies 
using written questionnaires covered all 
their employees.7 The costs of this 


TIbid., p. 17. 
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practice, however, increase as the num- 
ber and geographical distribution of 
those surveyed becomes greater. While 
complete coverage may be within the 
means of most individual companies 
using the written questionnaire method 
(particularly if these surveys are rela- 
tively infrequent), this is not the case 
where the interview method is used or 
where surveys are regional or national 
in scope. Under these circumstances, the 
problem of obtaining a satisfactory or 
representative sample of the total uni- 
verse has been a very real one. 


The essence of random sampling is 
that every person in the statistical uni- 
verse shall have an equal chance of being 
included in the sample. In order to ful- 
fill this condition, it is necessary that 
the survey designer either, (1) have 
available a complete file of the names of 
the population he is studying so that he 
may select every “Nth” name, or (2) be 
thoroughly familiar with the characteris- 
tics or dimensions of the population so 
that he may construct a stratified sample 
of the population which will include 
proper representation of each of the basic 
characteristics of the group, such as age, 
sex, race, geographical residence, educa- 
tion, and economic status. Not all 
studies of economic or occupational sub- 
groups, meet these conditions. Some 
regional or national surveys have used 
samples which were not truly represen- 
tative in the statistical sense of the 
word. In some instances regional stud- 
ies in industrial relations have included 
the experiences of employees in only a 
few of the larger companies in a par- 
ticular region. Some industrial studies 
carried out on a national basis have fre- 
quently been nation-wide only in the 
sense that they have included some de- 
gree of representation from more than 
one economic or geographical region. 
On the other hand, some organizations 
have been conscientious in their efforts to 
obtain a representative sample. A poll 
conducted by Fortune in June, 1940, for 
example, was composed of a rather ac- 
curate cross section of workers. This 


poll, which surveyed American workers’ 
attitudes toward unions, employers, 
strikes and other issues, included a rep- 
resentative cross section based on in- 
come, geographical distribution, age, 
sex, marital status, and other important 
statistical factors. In the case of attitude 
surveys of supervisory personnel, how- 
ever, no attempts have been made to 
obtain such a_ representative survey 
group. 

The statistical dilemma of the de- 
signer of attitude surveys in industrial 
relations arises in part from the scarcity 
of adequate statistical series for indus- 
trial and occupational subclassifications. 
Even were such a series existent, how- 
ever, the complexity of the task and the 
tremendous expenditures in time, human 
effort, and money that are necessary to 
prepare truly representative samples, 
place such studies beyond the reach of 
the vast majority of individuals and 
private organizations. As a result, stud- 
ies of this character are too often not 
representative of the statistical universe 
which they are surveying. 

This problem has been recognized im- 
plicitly or explicitly at one time or an- 
other by most social scientists. Pro- 
fessor Katz has labeled it “the selective 
bias of situations” by which he means 
that most social research is carried on 
where the climate is favorable and 
where the material is most readily 
available. If social phenoraena in areas 
in which data are difficult to obtain or 
the climate of opinion is antithetical to 
research are significantly different, then 
current research findings have definite 
limitations. In Professor Katz’s own 
words: 

“There is one problem of sampling 
the individuals within a single indus- 
trial situation and another problem of 
a representative sample of industrial 
situations. The second type of prob- 
lem has received little attention in the 
survey field. It raises many perplex- 
ing questions about the nature of the 
universe with which we are concerned 


and the dimensions according to which 
stratification should take place. One 


of the practical weaknesses thus far 
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has not been the selective bias of in- 
dividuals but the selective bias of 
situations. It has been much easier 
to undertake surveys in those plants 
where relations between management 
and labor are harmonious. Neither 
union leaders nor management wel- 
come surveys when they are dead- 
locked in a struggle.’’8 


The problem is one which the social 
scientist must face if he is to improve 
the validity and precision of his findings. 

There are other sampling problems 
which confront those carrying on attitude 
surveys in the field of industrial rela- 
tions. One of these is the selective bias 
which is introduced into sampling and 
is carried out through the medium of 
questionnaires mailed to the respondents. 
Statisticians generally agree that there 
may be important differences between the 
characteristics of the group who reply 
to mailed questionnaires and those who 
do not. These differences appear to be 
related to the degree of individual in- 
terest and involvement that the respond- 
ent feels with respect to the topical 
areas about which he is being asked to 
express an opinion. There is a likeli- 
hood that the proportion of persons an- 
swering will be significantly greater 
among those who hold extreme opinions 
(either pro or con) than among those 
who reflect a more neutral and hence 
more disinterested climate of opinion. 
Unless it is possible to determine the 
amount of selective bias by means of 
some sort of supplementary field work, 
the resulting findings may not be repre- 
sentative of the entire group. Unfor- 
tunately, practical considerations often 
render no other procedure feasible, par- 
ticularly in the case of surveys covering 
a broad geographical area. 

Another basic sampling problem in- 
volves the selective bias introduced by 
individual interviewers. Where the per- 
sonal interview method is used, bias may 
be introduced by the interviewer’s own 
opinions, attitudes, socio-economic status, 


8Daniel Katz, “The Measurement of In- 
tensity,” in H. Cantril, Gauging Public 
Ouinion, Princeton, Princeton University 
Press, 1944, p. 216. 


etc. A number of studies have revealed 
the possibility of sampling bias being 
introduced in quota control sampling 
through interviewer selectivity. Under 
the quota control procedure, the inter- 
viewer is directed to obtain a certain 
quota of interviews on such bases as sex, 
race, occupation, and geographical resi- 
dence, but he is not directed to any 
specific respondent. Thus, he can intro- 
duce selective biases based on his own 
affinities or the pressures of work. This 
limitation suggests that careful consid- 
eration should be given to the selection, 
training, and supervision of _ inter- 
viewers. 


Some studies have indicated that the 
results of personal interviews vary ac- 
cording to the interviewer’s own opin- 
ions on the issues on which he is ques- 
tioning the respondent. Those who hold 
one opinion tend to find a greater num- 
ber of respondents who hold a similar 
opinion than they do those who hold an 
opposing opinion. Presumably they have 
unconsciously interpreted the respondent 
in the light of their own personal biases. 
A National Opinion Research Center poll 
carried on in Southern cities in 1942 
found that the expressed opinions of 
negroes were different when they were 
interviewed by whites and negroes.? 
When asked, “Is it more important to 
concentrate on beating the Axis or to 
make democracy work better at home?” 
the white interviewers obtained a 62 
percent “beat the Axis” response, while 
negro interviewers obtained only a 39 
percent affirmative response. These and 
other problems are introduced with the 
use of the personal interview method. 
While the personal interview procedure 
may still be preferred over other survey 
methods because of various important 
advantages which it possesses, those 
using this medium should be made aware 
of these limitations so that proper pre- 
cautions can be taken. 


9David Krech and Richard S. Crutchfield, 
op. cit., pp. 290-291. 
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PROBLEMS OF SURVEY 
ADMINISTRATION 

There are number of difficulties which 
are likely to be encountered in the ad- 
ministration of the written attitude sur- 
vey. Some of them are related to the 
type of survey, the method of presenta- 
tion, and the nature of the group being 
surveyed; but several of them are com- 
mon to all such questionnaires and 
warrant special consideration. 

One of the problem areas of survey 
administration is that of establishing 
proper rapport. This condition is just 
as necessary to the success of a written 
questionnaire survey as it is to a survey 
based on the interview, although it is 
perhaps not so obvious in the former 
case as in the latter. If we define 
rapport (as it applies to the written 
questionnaire situation) as a state of 
mind which engenders interest in the 
project, sympathy with its objectives, 
and a willingness to cooperate by an- 
swering questions accurately and 
thoughtfully, then the success of the sur- 
vey, i.e., completeness, reliability, and 
validity of the findings, depend to a 
great extent on the attainment of this 
objective. The necessity for giving ade- 
quate consideration to this problem prior 
to the actual administration of the sur- 
vey is more important when the written 
questionnaire is used than when the 
personal interview is the medium of in- 
quiry. This stems from the fact that a 
properly trained interviewer is usually 
able to perceive when adequate rapport 
is lacking and can take steps to correct 
this situation by varying his approach, 
line of questions, or in some other way 
winning the confidence and cooperation 
of the respondent. In the case of the 
written questionnaire, because the ad- 
ministrator of the survey and respond- 
ents have limited personal contact, this 
is not possible. Even when a lack of 
rapport is perceived, it is difficult to cor- 
rect the condition once the survey has 
begun and the respondents are busy 
answering their questionnaires. In the 
case of the mailed questionnaire, the 


opportunity is practically nonexistent. 

One of the most successful ways of 
arousing interest and curiosity among 
the members of a prospective survey 
group is through advance publicity. A 
number of individual companies have 
apparently been quite successful in 
attaining this goal. While practice 
varies considerably, companies do utilize 
such methods as articles in the house 
organs, letters from company executives, 
bulletin boards, and public speaker sys- 
tem announcements. A number of com- 
panies have found it advisable to pro- 
ceed cautiously, particularly in the case 
of the initial survey. It is considered 
good practice to carry one or two short 
news items dealing with the projected 
study in the company magazine or plant 
paper and then at a later date, a more 
complete account of the final plans. A 
letter from the president explaining the 
purposes of the survey is always in order 
and may be followed by publicity through 
other media of communications. Super- 
visory meetings have been found to be 
very helpful in gaining support and en- 
thusiasm from the various levels of 
supervision. Supervisors may be asked 
to supplement other methods with a 
verbal explanation and a question-and- 
answer period prior to the survey presen- 
tation. The quantity and elaborateness 
of the introductory publicity campaign 
will undoubtedly depend on the number 
of employees to be reached, their morale, 
the availability of various channels of 
communications, previous experience 
with similar surveys, etc. Some pre- 
survey publicity, however, is essential 
if proper rapport is to prevail. Within 
the limitations of budget and the needs 
of the situations, careful plans should, 
therefore, be drawn for acquainting the 
survey group with the nature and pur- 
pose of the study, the mechanics of pro- 
cedure, and the value of the study to the 
individuals being surveyed. 


Presurvey publicity may be organized 
so as to approach the ideal in the case 
of industrial attitude surveys being car- 
ried out within individual companies. 
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The existence of a variety of communica- 
tion channels and the fact that the peo- 
ple employed and those to be surveyed 
constitute the same group make condi- 
tions very favorable for the development 
of adequate rapport. This is not usually 
the case with those studies covering a 
wider geographical and organizational 
area. In most cases, regional or national 
polls are administered with very little, 
or completely without, prior preparation 
of the survey group. Unless the mem- 
bers of the survey group are a part of 
a common organizational structure, the 
dissemination of pretest publicity is 
nearly impossible. The casual way in 
which respondents are chosen in many 
surveys precludes any presurvey prepa- 
ration. Unwillingness of survey admin- 
istrators to test the patience of casual 
respondents may also be a deterrent. 


Another consideration which is related 
to the whole question of rapport is that 
of anonymity. Most students of public 
opinion agree that anonymity is essen- 
tial to the success of attitude surveys. 
There are few who would challenge the 
assertion that added gains in validity of 
findings which accrue from assuring the 
anonymity of the individual respondent 
more than outweigh any possible advan- 
tages resulting from being able to iden- 
tify the individual respondent. Most 
persons will agree that it is not only 
very important that anonymity be main- 
tained but also that great pains should 
be taken to assure the members of the 
survey group of this condition. It can- 
not be taken for granted that those 
being surveyed will assume that their 
identity will be concealed in the final 
report. On the contrary, evidence 
available on this subject tends to indi- 
cate that the inherent inclination of the 
prospective respondent in most survey 
situations is one of suspicion and appre- 
hension lest in some way his or her re- 
marks will be identified. This bespeaks 
the importance of taking adequate steps 
to insure the confidential nature of the 
survey. 


The problem of assuring anonymity is 


greater in some survey situations than 
in others. Wherever the survey is being 
administered by the employer or through 
the initiative of the employer, the prob- 
lem is paramount. In this respect, the 
attitude survey carried on by the indi- 
vidual company is at a considerable dis- 
advantage as compared with those 
initiated and administered by independ- 
ent groups. Even in the latter case, 
however, the problem is present because 
the respondent can easily conceive of 
situations where the results could be 
brought to the attention of his employer. 


There seem to be effective ways of 
assuring the respondent that his answers 
will remain confidential. In the case of 
the written questionnaire, the fact that 
surveys are administered to relatively 
large numbers in the same room at the 
same time is in itself an indication that 
identification would be difficult. Anony- 
mity is reinforced by the fact that an 
objective type of question is used which 
requires no handwriting and that com- 
ments are optional. In the case of per- 
sonal interviews, however, there is no 
prima facie case for anonymity. The 
latter method relies on the effectiveness 
of the presurvey publicity and the efforts 
of the individual interviewer to convince 
the respondent that his identity will be 
held inviolate. There are many survey 
experts who hold that the personal in- 
terview survey can never be completely 
effective in gaining the confidence of the 
respondents for this reason. While this 
conclusion may not be justified, it does 
serve to highlight the greater difficulties 
encountered in allaying the fear of iden- 
tification when the personal interview 
method is used. 


Another effective method of dealing 
with this problem is to employ the 
services of an independent individual, 
agency, or organization to conduct the 
survey. If the independent party is 
properly introduced and identified and if 
this person administers the survey and 
promises to protect the employees 


against identification, fears of identifica- 
tion are greatly reduced. There are cer- 
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tain procedures, which, if followed, seem 
to be of additional help in creating con- 
fidence. Many experts suggest that a 
large ballot-box type of receptacle, 
adequately padlocked, be placed at the 
front of the room and that respondents 
be asked to deposit their questionnaire 
therein. The participants are informed 
that the box will not be opened until it 
reaches the office of the agency that is 
conducting the poll. Another practice is 
to ask volunteers from the respondent 
group to distribute the questionnaires. 
Questionnaires should be free from un- 
identified symbols, letters, or numerals 
that might tend to arouse suspicions 
among the survey group that some 
secret system of identification is being 
used. 


The degree of success which is 
attained in assuring the survey group 
that their replies will be held confidential 
depends upon the degree of confidence 
which the group places in the organiza- 
tion sponsoring and conducting the sur- 
vey. In the case of surveys conducted 
by individual companies among their 
own employees, the company’s record for 
fair and impartial treatment and its 
reputation for keeping its word will be 
important factors in obtaining a frank 
and constructive response to the atti- 
tude survey which it is conducting. 
Where similar attitude surveys have been 
conducted before, the experience of the 
survey group with the results—the fact 
that no attempt was made to identify 
individual respondents and the fact that 
concrete actions were taken as a result 
of the study—will serve in great part 
to increase the willingness of the group 
to cooperate and express itself frankly 
and fully. 

Another consideration which is related 
to the problem of rapport is that of pro- 
viding an adequate explanation of the 
procedure the respondents should fol- 
low in completing the questionnaire. In 
the case of the personal interview 
method, the mechanical aspects are 
handled by the interviewer; he can in- 
troduce corrective action if he finds that 


the respondent is not making the proper 
type of response. Where the written 
questionnaire is used, the administrator 
must rely on the clarity of the verbal 
explanations before the survey gets 
under way and the written explanations 
which are usually prominently placed at 
the beginning of the questionnaire. It 
is therefore wise to give adequate 
thought to this problem in designing the 
questionnaire and the preliminary pre- 
sentation of the administrator. In this 
way, most of the respondent’s difficul- 
ties will probably be anticipated and a 
considerable amount of confusion and 
uncertainty will be avoided. Some sur- 
vey experts recommend that instructions 
should be printed and prominently placed 
on the questionnaire, that the survey 
administrator read the instructions aloud 
after distributing the survey, then, as a 
final guarantee, afford members of the 
survey group an opportunity to ask 
questions about the method to be fol- 
lowed. Despite the most careful pre- 
cautions there will always be a few 
participants who will not follow in- 
structions. 

Closely allied to the above problem is 
that of obtaining uniform presentation 
and administration when surveys are 
administered to more than one group at 
different times. The problem is further 
complicated when the number of groups 
involved necessitates a number of per- 
sons to administer the survey. Under 
these circumstances, there is always the 
possibility of introducing factors that 
may influence the responses of par- 
ticipants. 

The best insurance against this 
eventuality seems to be adequate in- 
struction of those who will administer 
the survey. Where the survey is to be 
carried on through the medium of per- 
sonal interviews, this problem not only 
involves the preliminaries of administer- 
ing the survey but applies to the entire 
process of the interview itself. While 
the possibilities of bias are greater in 
the personal interview, this tendency, in 
part, is overcome by the universal aware- 
ness of its existence by those using this 
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method and the efforts made to minimize 
this limitation. The problem is not as 
apparent when the written questionnaire 
is used, and so may be more readily 
overlooked. 


PROBLEMS OF SURVEY ANALYSIS 
AND INTERPRETATION 

To a great extent, the process of 
analysis and the results of that process 
are determined by the earlier aspects of 
survey construction and administration. 
Mistakes which have been made in the 
design and administration of the study 
become evident in the analysis which 
follows, but this is too late to permit 
corrective action. 

One of the dangers of survey analysis 
is that the analysts fall into the com- 
mon error of carrying out routine tabu- 
lation of questions using as many 
breakdowns and correlations as_ the 
survey permits. Messrs. Krech and 
Crutchfield point out that: 

The keynote of analysis should be 
the testing of hypotheses (author’s 
italics) which means the study of cer- 
tain breakdowns and cross tabulations 
that have been deliberately provided 
for in the study design. There is 
nothing wrong with the exploration of 
new and unexpected relationships, but 
it should be a planful research, dic- 
tated by hunches and hypotheses and 
not by the mere combinatorial possi- 
bilities of a Hollerith machine. .... 
The overall percentages of answers 
provide little analytic significance. 
What is necessary is to break down 
the data into subclassifications so that 
they can be compared: and correlated. 
In this way the psychological and 
sociological determinants of opinions 
and attitudes may be revealed.19 
These authors also warn against the 

excessive use of sociological break- 
downs, that is, breakdowns on the basis 
of sex, age, education, income, etc., or 
at least against the uncritical interpre- 
tation of findings based on such break- 
downs. They hold that “differentiation 
of opinions and attitudes is not likely 
to take place primarily along lines of 
age, sex, place of residence, occupation, 
etc., except in special circumstances.” In 
their opinion, the fact that these socio- 


10Tbid.. p. 302. 


logical breakdowns do yield differences 
of opinions is usually an artifact based 
on the reality that they are related to 
basic determining variables. They recom- 
mend, as do McNemar and others, the 
use of psychological rather than socio- 
logical breakdowns, that is, breakdowns 
based on political preferences, person- 
ality traits, etc. This criticism overlooks 
the fact that sociological breakdowns of 
attitude and opinion may be of signifi- 
cance in company surveys. It also fails 
to take into account the fact that mean- 
ingful psychological breakdowns usually 
are difficult to obtain except through 
rigorous questioning of the respondents. 

There are certain specific aspects of 
the interpretation of survey findings 
which constitute areas in which faulty 
interpretation may lead to erroneous 
conclusions. One of the most common 
mistakes is to attribute statistical sig- 
nificance to differences in results which 
grow out of sampling errors. Unless 
adequate tests of significance are used, 
differences which can be attributed solely 
to sampling errors may be assumed to 
have importance. 

Another problem has to do with the 
determination of differences that are of 
social or psychological significance. A 
difference may be obtained which is 
statistically significant but which may 
nonetheless be too small to be of any 
significance from a social or psycho- 
logical standpoint. The researcher must 
be mindful of the fact that not all statis- 
tically significant differences are socially 
or psychologically significant. 

Another common pitfall with regard 
to the interpretation of attitude surveys 
is to rely too greatly on the significance 
of absolute determinations of attitude or 
morale. The possibility of a consistent 
upward bias in attitude survey findings 
should suggest caution in hazarding too 
unqualified optimism about survey find- 
ings which indicate very favorable atti- 
tudes. Differences in attitudinal levels 
among subclassifications of the survey 
group are likely to yield much more 
valuable insights. 

In connection with the differences be- 
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tween relatives and absolutes, it is 
worthy of note that another common type 
of error is frequently made. It is that 
of attributing too great a significance 
to percentages and percentage changes 
in data. In working with small numbers, 
large percentage changes and differences 
are readily found which are of little or 
no absolute significance. An increase 
from one unit to two units, for example, 
is an increase of 100 percent, but this 
may be of no real significance. Very 
closely related to this is the practice of 
blowing up percentages. In effect, the 
projection of percentage differences ob- 
tained from a relatively small sample 
into correspondingly high absolute fig- 
ures for an entire universe may lead to 
unwarranted and very erroneous con- 
clusions. McNemar notes this latter 
practice, reporting on one study where 
applied to a total population of 20 mil- 
lion yielding a prediction that seven 
million persons would so act. Consider- 
ing the possible sampling error based on 
400 cases, correct figures for the entire 
universe might have varied between six 
million and eight million.11 

Another practice with which McNemar 
and other methodologists take issue is 
that of failing to give adequate descrip- 
tion of the sampling methods used and 
the tests applied to determine the sig- 
nificance of the data. Without such in- 
formation, the reader is not in a position 
to make an informed judgment upon 
the adequacy of the research methods 
or the validity of the findings. In the 
same vein, and an equally serious breach 
of good practice in reporting and inter- 
preting survey findings, is that of 
concealing absolute results in percentage 
or relative figures. Findings based 
upon percentages which conceal the ab- 
solute figures from which they were 
drawn should always be viewed with 
suspicion. 

One other practice of doubtful validity 
which is frequently used in the inter- 


11Quinn McNemar, op. cit., p. 339. 


pretation of attitude survey results is 
that of attributing equal significance to 
similar absolute results on different 
questions. It is a real temptation for 
the analyst to fall into this practice 
when quantitative values are assigned 
to different degrees of responses to dif- 
ferent questions. If, for example, per- 
centile quantities were computed for 
four or five alternative answers of each 
of a series of questions dealing with 
various phases of morale and job rela- 
tions, an over-all index of morale might 
be obtained by taking an average of 
the mean or median response for each 
one of the questions in the series. This 
would be tantamount to assuming that 
each of the questions dealt with a phase 
of industrial relations which was of equal 
significance in determining the over-all 
morale of the individual, inasmuch as 
each question would have been given 
equal weight in the measurement of the 
individual’s morale. 

There are doubtless other common 
errors of analysis. Those that have 
been presented serve to illustrate the 
sort of pitfalls which confront the novice. 


CONCLUSION 


The treatment of methodological prob- 
lems in this article is not intended to be 
exhaustive. The writer has attempted to 
present the problems of attitude survey 
methodology which experts currently 
writing in this field stress. This exposi- 
tion has been prompted by concern for 
the fact that methodological considera- 
tions are germane to any research study 
no matter how applied or practical its 
orientation may be. The use of the atti- 
tude survey in industrial relations will 
continue to grow in the future as a re- 
sult of growing awareness on the part 
of management, union officers and social 
scientists of its value in determining the 
climate of employee opinion and morale. 
The validity and precision of the results 
obtained from the use of this technique 
will depend in no little part, therefore, 
on the degree of familiarity of the 
users with its inherent methodological 
problems. 


Creative Thinking: 
Practical Techniques and Evaluation Methods 


by CLAIR JAMES REILLY* 


There are several techniques which can 
be used to get greater output from indi- 
viduals and groups. These techniques 
deal with the tapping of mental re- 
sources or the creativeness of every one 
within an organization or group. This 
article deals with these techniques and 
suggests the necessity for evaluating the 
results. The check list and scientific 
methods which help to develop a basis 
for judgment are also discussed. 


THE creative resources of people are 
not being utilized to the fullest ex- 
tent. Much is written about the utili- 
zation and preservation of our natural 


resources. The mental resources of 
groups and individuals are. equally 
important. Organizations, therefore, 


should be aware of the ways of increas- 
ing productivity by stimulating the 
thought processes of their personnel. 
Case studies show, for example, that 
techniques of stimulating creativeness of 
individuals and groups have improved 
the functions of advertising, plant pro- 
duction, education, military planning, 
family relations, and other areas in which 
creative imagination contributes to bet- 
ter decision making and harmony. 


GROUP IDEATION 


The first and most widely quoted tech- 
nique of stimulating creativity in people 
is generally called “brainstorming.”! 
This is simply a way of idea production 
through group thinking which produces 
workable solutions to problems. Motiva- 
tion, innovation, and positive stimuli are 
essential to stimulate creativity in terms 
of ideas from groups. Tests made at 


*Clair James Reilly is a member of the Mar- 
keting faculty of the Temple University 
School of Business and Public Administra- 
tion. He is also a marketing consultant. 

1The writer acknowledges the data sent by 
Mr. Alex Osborn, Chairman of the Creative 
Education Foundation, 1614 Rand Building, 
Buffalo 3, New York. 


the University of Buffalo show that ideas 
produced through this uninhibited group 
approach are 65 percent to 93 percent 
more numerous than those derived from 
individual effort.2 There are those, 
however, who think that creativity is 
more of an individual effort than a group 
process. This feeling exists especially 
in areas of painting, and editorial de- 
sign.3 It should be reported also that 
many brainstorming sessions do not seem 
to work due to lack of support or orien- 
tation of management.4 


Creative Thinking 
and Knowledge 


The advocates of creative thinking de- 
fine creativity as an attempt to get a 
new idea or concept. The idea may 
come spontaneously, or through the 
formulation of the problem. 

Creativity may be also considered a 
part of the system of logic known as 
the inductive and deductive processes.5 
Thoughts about creativity can be traced 
to the writings of Aristotle and Plato. 
Practical techniques of creative thinking 
as practiced by business and industry, 
however, are of recent development. 


The concept and practice of creative 
thinking evolve from the nature of the 
mental powers of individuals. Knowledge 
and creative thinking are distinguished 
as follows: 


1. Absorbtive Power—the ability to 
observe, and then to apply atten- 
tion. 


2. Retentive Power—the ability to 


2Lester R. Bittel, “Better Way to Solve 
Plant Problems,” Factory Management and 
Maintenance, May, 1956, p. 99. 

3See “Brainstorming: Ideator or Opiate,” 
Printers Ink, November 16, 1956, p. 34. 

4B. B. Goldner, ‘‘Why Doesn’t Brainstorm- 
ing Always Seem to Work?” Sales Manage- 
ment, October, 1956. 

5Myron S. Heidingsfield, “The Techniques 
of Creative Thinking,” address before the 


Philadelphia Direct Mail Club, April, 1956. 
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memorize and recall. 


3. Reasoning Power—the ability to 
analyze and to judge. 


4. Creative Power—the ability to 
visualize, to foresee, and to gen- 
erate ideas.é 

We learn through the first two, as in 

school or college, and think by use of 
the latter two. It is reasoning and 
creative powers, then, that lead to tech- 
niques of solving problems through idea 
production. 


How to Brainstorm 


Brainstorming had its first application 
in business by Batten, Barton, Durstine 
and Osborne,? an advertising agency in 
New York City. This organization at 
present produces about ten thousand 
ideas a year for clients. This work is 
the creative result of idea conferences, 
originated by Willard Pleuther, Director 
of Creative Services. For these sessions 
a panel of twelve is considered the opti- 
mum size. There are five core members 
and a number of guests who meet every 
day in a conference room during the 
lunch hour. All panel members are 
oriented and are ready to talk freely. 
Scheduled topics may range from media 
selection to finding new uses for 
products. 


Brainstorming differs from other idea 
generating techniques mainly in strict 
adherence to a set of rules. These rules 
as practiced by Batten, Barton, Durstine 
and Osborne are as follows: 

1. Don’t criticize. Evaluation or 

judicial thinking should come later. 

2. Encourage free wheeling. The 


more imagination the better. No 
idea is too wild or remote. 

3. Get as many ideas as possible. 
Good ideas evolve from quantity. 
Members will keep up with a pace 
setter. 

4. Combine and improve. Ideas be- 
come more concrete by association 
with other ones. “Hitch-hiking” is 


encouraged. 
6Alex F. Osborn, Applied Imagination, 
Charles Scribner’s Sons, New York, 1953, 
Chapter 10. 
7‘Stuck for Sales? Then Try Brain- 
storming,” Industrial Marketing, November, 
1956, p. 156 


All attitudes and conditions, therefore, 
must be positive. 


Advertising agencies, then, are strong 
proponents of group thinking. The 
slogan “Soup on the Rocks,” and the 
eighteen ways of promoting colored tele- 
phones are some results of these buzz 
sessions. In this respect one advertising 
trade journal conducts a continuous 
brainstorming session on how advertis- 
ing agencies can improve their idea 
output.§ 


Characteristics of 
Creative Ability 


There is little agreement among psy- 
chologists as to the definition of creative 
ability. There is more agreement, how- 
ever, as to the characteristics associated 
with creativity.2 They are as follows: 

1. Problem sensitivity. The ability to 

recognize a problem. 

2. Idea fluency. The piling up of a 

number of alternative solutions. 


3. Flexibility. The development of a 
variety of approaches. 


4. Originality. The derivation of new 
ideas, or at least new to the indi- 
vidual. 


Many organizations are now employing 
creativity directors in order to stimulate 
and to utilize the creative abilities of 


all employees. 


A pilot study of what creative men 
say about their own thought processes 
illustrates the conditions of creativity.1° 
Most of the respondents thought they 
could do their best work under given 
physical conditions, by outlining the 
problem, by revising and improving on 
ideas after acceptance, by preparation 
for the process by reading nonrelated 
matter, and by continuous effort. 


&8——., “How Advertising Agencies Can 
Boast Their Idea Output,” Industrial Market- 
ing, January 1957, pp. 59-60. 

9“Practical Techniques in Creative Think- 
i Management Review, March, 1956, p. 


10Herbert True, “How To Be Creative.” 


Printers Ink, January 4, 1957. 
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Psychological Climate 


The technique of brainstorming is be- 
coming widely accepted. General Elec- 
tric, General Motors, Standard Press 
Steel, R.C.A., U. S. Steel, colleges, and 
the Air Force are among those now hav- 
ing creative thinking courses. General 
Electric has had a creative engineering 
program since 1937. The Air Force uses 
brainstorming in its ROTC courses. 
Colleges and universities have formal 
or industry extension courses. 


Planning Education 


Temple University presents an inter. 
esting illustration of utilizing the 
creativeness of its faculty-administrative 
personnel in planning for the increase in 
student enrollment in the future. The 
college student body in the United States 
has shown continuous growth since 1870, 
at which time there was an enro!iment 
of 42,286 students. Enrollment increased 
to 2,755,000 in 1955, and is expected to 
rise to 4,368,756 in 1970-1971.11 


The Temple University Conference 
took place at Atlantic City during a re- 
cent recess under conditions conducive 
to stimulating the creativity of every- 
one. Problem areas were first defined 
and then were discussed by _ small 
groups. After discussion or free asso- 
ciation of ideas, the groups prepared 
drafts of their recommendations. 

Such topics as entrance requirements, 
teaching load, promotion, teacher recruit- 
ment, future faculty needs, junior col- 
leges, evening schools, and physical plant 
were discussed. Asa result of this series 
of conferences, the University adminis- 
tration will be better prepared to meet 
the problems that will certainly arise as 
enrollments expand; and a_ short-run 
awareness of the problem itself was 
achieved by all participants. 


Case Study Method 


The creative imagination of many col- 
lege students remains relatively dormant 
or untapped. Courses in which the 


11Benjamin Fine, “Education in Review,” 
New York Times, April 28, 1957. 


student is required to memorize prin- 
ciples and facts do little to stimulate 
creativity. A student, especially in the 
advanced courses, should be taught how 
to apply principles and facts to the 
solutions of problems. 

The case study, the second of the 
technqiues of creative thinking to be dis- 
cussed, stimulates creativity by requir- 
ing students to develop ideas through 
induction, deduction, or by perceiving 
interrelationships of subjects. 


One technique that stimulates and 
guides creativity of the foregoing nature 
is as follows: 

Preparation and Analysis 


Divide the case into four parts: A, B, 
C, D.12 

Part A includes factors and charac- 
teristics. Outline the pertinent facts 
about the company, giving the products 
manufactured, the class or classes of 
buyers to whom it is sold, the channels 
of distribution used, the selling program, 
and other information that will give a 
picture of the company and its problems. 

Part B defines the problem. Its pur- 
pose is to assure that there is a “meet- 
ing of the minds” among the participants 
as to the problem or subproblems to be 
studied. 


Part C presents the decision. Herein 
is the presentation of the conclusion. 
The students are urged to deliberate and 
revise content and substance as informa- 
tion, data, or better logic results from 
work with the problem, making this 
section indeed the last to be prepared. 

Part D presents the analysis upon 
which the conclusion was based. This is 
the most important part of the study. 
In it the analyst must detail the data 
and information and the methods of use 
which support his decision. He must 
determine the assumptions required and 
the reasons for their use. All necessary 
exhibits or studies should also be pre- 
sented either here or in an appendix. 
Finally one should be sure that the re- 


12Developed by the writer for his course in 
Industrial Marketing. 
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port is reasoned, that is, that disad- 
vantages as well as advantages of each 
course of action are cited. All data 
should be documented fully. 

The student should now be ready to 
defend his course of action before the 
class. Since questions are creative acts 
of intelligence, an improved course of 
action often evolves through combination 
and association of ideas through group 
participation. 


Relationships 


The forced relationship technique is 
used by many copy writers.13 Here the 
individual will take two objects or topics 
and attempt to think out all of the pos- 
sible relationships between the two. 
Cafeterias and supermarkets, or a 
portable TV set and portable sewing ma- 
chine would be examples. The result is 
the multiplication of ideas which may be 
developed into copy and sales promotion 
pieces by such association of ideas. All 
evaluation or criticism should be re- 
served until one has thought of as many 
relationships as possible. 


Operations 


William Gordon of Arthur Little, Inc., 
management consultants, has developed 
a technique of utilizing creativity known 
as free association.14 Conference mem- 
bers are encouraged to talk freely about 
a topic cited by the leader. No one 
except the conference leader knows how 
the problem is defined. Through the 
process of associating ideas, panel mem- 
bers eventually define the problem. All 
seek one answer to the problem. The 
conference leader, for example, may cite 
his dissatisfaction with services rendered 
by wholesalers. A member in associa- 
tion with others may talk about direct 
marketing. Soon the problem is defined 
as one involving the selection of a new 
channel of distribution. Again, one 
answer is sought. As with other group 


13James E. Gates, “Applied Imagination 
and Creative Thinking,” Georgia Business, 
The Bureau of Business Research, The Uni- 
versity of Georgia, September, 1956, p. 5. 

14Management Review, op. cit., p. 208. 


thinking approaches, a prerequisite of 
success is to have a good conference 
leader. 


EVALUATION 


Management should have check lists 
or methods to aid in evaluating ideas 
or thoughts in these conferences that 
postpone criticism. The scientific method 
should be used as a guide for evaluation 
wherever possibie. Dr. Conant said that 
science is that portion of accumulated 
knowledge in which new concepts are 
continuously being developed from ex- 
periment and observation.15 From em- 
pirical knowledge, then, one has the 
framework from which to evaluate. 
Some methods which aid evaluation, in 
part, follow. 


Product Check List 


A committee, for example, might be 
appointed to appraise the new product 
ideas which have been developed by 
a previous brainstorming session. A 
marketing check list to help introduce 
a new product serves to guide judgment 
by the committee. This check list, there- 
fore, tends to lower the mortality rate— 
eight out of ten new products fail. Some 
key items in the marketing check list 
are as follows: 

1. Is the new product salable? 
test the product, 
potentials. 

2. How will the product be dis- 
tributed? Are the factors that 
favor direct sale, or use of whole- 
sale middlemen known? 

3. What is the “share of market” of 
the competition? List advantages 
and disadvantages of competitors’ 
products and services. 

4. How will price be determined? 
The pros and cons of a one-price 
policy and discount policies should 
be analyzed. 

5. What selling program has_ been 
prepared? Personal selling, adver- 
tising and sales promotion require- 
ments should be analyzed.16 


Pre- 
check market 


15Osborn, op. cit., p. 19. 


16For other checks see, Richard Mansville 
and Joseph Ungar, “Marketing Checklist For 
ae Products,” Printers Ink, February 1, 


34 CREATIVE THINKING: 


PRACTICAL TECHNIQUES AND EVALUATION METHODS 


Research Check Lists 


Any ideas relevant to marketing re- 
search should also be subject to the 
scientific method of investigation. The 
following, in brief, should be considered. 

1. The problem must be defined. It 


should be made concrete, or al- 
ternatives cited. 


2. Primary and secondary sources of 
information should be checked. 


3. Accepted sample design should be 
used. Probability sampling, for 
example, may be applicable. 


4. Tests of phraseology in question- 
naire design should be made. 


5. Interviewer bias should be mini- 
mized by better selection and 
training.17 

One of the above areas that is some- 

what difficult to evaluate is personal 
interviewing. Some of the difficulties 
of interviewing and a relatively new 
method of conducting such contacts 
follow. 


Creative Interviewing 


It is very difficult to determine the 
buying intentions of consumers. Inter- 
view results may show preferences for 
a given brand of a product. Two months 
later the consumer may purchase another 
product brand. The consumer’s actual 
behavior and the propensity to spend are 
very difficult to predict.1§ 


To be creative, research must be pre- 
dictive. Therefore, one should study the 


17Additional information can be found in 
Market and Marketing Analysis, Myron S. 
Heidingsfield and Albert Blankenship, Henry 
Holt and Company, New York, 1957. 

18Arthur Burns, “The Instability of Con- 
sumer Spending,” National Bureau of Eco- 
nomic Research, Annual Report, 1952. 


reactions of consumers. This means that 
the interviewer should create conditions 
parallel to those under which a person 


buys. The reactions of the consumer to 
such stimuli are continuously being 
observed.19 


Utilizing Creativity 

Of the techniques of creative think- 
ing, brainstorming is the most widely 
accepted because everyone can contribute 
his ideas. Organizations should, there- 
fore, utilize one of the techniques of 
creative thinking as a means of tapping 
mental resources. Conditions which 
eliminate emotional blocks are essential 
since repressed emotions stifle creativity. 
In terms of Freudian psychology, allow 
the ego, the conscious part of the mind 
capable of intellectual development and 
rational judgment, to employ the libido, 
the fund of energy upon which the mind 
draws, to work toward greater produc- 
tivity of ideas. Directors of creative 
thinking must have the skill to stimulate 
and guide the efforts of people in this 
direction. 


The case study does much to stimu- 
late creativity through preparation and 
analysis if the technique cited is care- 
fully used. The forced relationship and 
the Gordon techniques also serve to 
utilize idea resources. 


Evaluation is essential in all of these 
processes. The best guide to evaluation 
is empirical judgment which requires 
adherence to the scientific approach. 


19A. Politz, “Science and Truth in Market- 
ing Research,” Harvard Business Review, 


January-February, 1957, p. 119. 
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Philadelphia Business Index 


The September 1950 issue of the Bul- 
letin presented a new index of general 
business conditions in the City of Phila- 
delphia. This series, prepared and since 
maintained by Robert T. Kline, was de- 
signed to reflect economic activity 
exclusively within the boundaries of the 
City of Philadelphia. It was originally 
based upon a combination of statistical 
data representing (1) industrial electric 
power sales; (2) indexes of employment 
and employee-hours; (3) department 
store sales!; (4) bank debits?; and (5) 
total construction. Because the method 
of reporting certain data is under re- 
vision by the originating agencies, the 
change in average weekly hours worked 
and the monthly change in total employ- 
ment in the Philadelphia metropolitan 
area, both prepared by the Department 
of Research of the Federal Reserve Bank 
of Philadelphia, have been substituted 
for (2) above. This is a temporary ex- 
pedient to maintain continuity of the 


1The revised index of Department Store 
Sales, published by the Federal Reserve 
Bank of Philadelphia, has been used in the 
composite index since October, 1951. 


2The revised Wholesale Price Index, all 
commodities, published by the BLS, is used 
beginning January, 1952 as a deflationary 
index for the Bank Debit Series. 


index. The original data series will be 
restored after revision. 

The following table presents the index 
for the years 1939 through 1956 and by 
month from May, 1956.3 


Index of General Business Conditions, 
City of Philadelphia, 1947=100 


Year Index Month Index 
1939 73 1956 

1940 17 May 129.7 
1941 96 June 127.6 
1942 99 July 129.1 
1943 106 Aug. 131.0 
1944 106 Sept. 133.7 
1945 98 Oct. 128.7 
1946 100 Nov. 126.0 
1947 100 Dec. 125.0 
1948 103 1957 

1949 97 Jan. 124.3 
1950 108 Feb. 125.0 
1951 111 Mar. 124.0 
1952 111 Apr. 124.3p 
1953 119 May 125.0e 
1954 119 

1955 124 

1956 128 


p=preliminary 
e=estimated. Based on currently pub- 
lished weekly indicators. 


‘Kline, Robert T., “A Measurement of 
General Business Conditions in the City of 
Philadelphia.” Economics and Business 


Bulletin, Temple University School of Busi- 
ness and Public Administration, Philadel- 
phia, Pa., September, 1950, pp. 33 
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feature in each issue. 


3 Reference numbers may be found in the Chronological Index. 
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